Apr 12 07:32:55 user devstack@n-api.service[72694]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 07:32:55 user devstack@n-api.service[72694]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 07:32:55 2023] *** Apr 12 07:32:55 user devstack@n-api.service[72694]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 07:32:55 user devstack@n-api.service[72694]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 07:32:55 user devstack@n-api.service[72694]: nodename: user Apr 12 07:32:55 user devstack@n-api.service[72694]: machine: x86_64 Apr 12 07:32:55 user devstack@n-api.service[72694]: clock source: unix Apr 12 07:32:55 user devstack@n-api.service[72694]: pcre jit disabled Apr 12 07:32:55 user devstack@n-api.service[72694]: detected number of CPU cores: 12 Apr 12 07:32:55 user devstack@n-api.service[72694]: current working directory: / Apr 12 07:32:55 user devstack@n-api.service[72694]: detected binary path: /usr/bin/uwsgi-core Apr 12 07:32:55 user devstack@n-api.service[72694]: your processes number limit is 63637 Apr 12 07:32:55 user devstack@n-api.service[72694]: your memory page size is 4096 bytes Apr 12 07:32:55 user devstack@n-api.service[72694]: detected max file descriptor number: 2048 Apr 12 07:32:55 user devstack@n-api.service[72694]: lock engine: pthread robust mutexes Apr 12 07:32:55 user devstack@n-api.service[72694]: thunder lock: enabled Apr 12 07:32:55 user devstack@n-api.service[72694]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 07:32:55 user devstack@n-api.service[72694]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 07:32:55 user devstack@n-api.service[72694]: Python main interpreter initialized at 0x560f240b7990 Apr 12 07:32:55 user devstack@n-api.service[72694]: python threads support enabled Apr 12 07:32:55 user devstack@n-api.service[72694]: your server socket listen backlog is limited to 100 connections Apr 12 07:32:55 user devstack@n-api.service[72694]: your mercy for graceful operations on workers is 90 seconds Apr 12 07:32:55 user devstack@n-api.service[72694]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 07:32:55 user devstack@n-api.service[72694]: *** Operational MODE: preforking *** Apr 12 07:32:55 user devstack@n-api.service[72694]: *** uWSGI is running in multiple interpreter mode *** Apr 12 07:32:55 user devstack@n-api.service[72694]: spawned uWSGI master process (pid: 72694) Apr 12 07:32:55 user devstack@n-api.service[72694]: spawned uWSGI worker 1 (pid: 72695, cores: 1) Apr 12 07:32:55 user devstack@n-api.service[72694]: spawned uWSGI worker 2 (pid: 72696, cores: 1) Apr 12 07:32:55 user devstack@n-api.service[72694]: spawned uWSGI worker 3 (pid: 72697, cores: 1) Apr 12 07:32:55 user devstack@n-api.service[72694]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 07:32:55 user devstack@n-api.service[72695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 07:32:55 user devstack@n-api.service[72696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 07:32:55 user devstack@n-api.service[72697]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 07:32:59 user devstack@n-api.service[72695]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 07:32:59 user devstack@n-api.service[72695]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 07:32:59 user devstack@n-api.service[72695]: and ``live_migration_inbound_addr`` respectively. Apr 12 07:32:59 user devstack@n-api.service[72695]: ). Its value may be silently ignored in the future. Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 07:32:59 user devstack@n-api.service[72696]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 07:32:59 user devstack@n-api.service[72696]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 07:32:59 user devstack@n-api.service[72696]: and ``live_migration_inbound_addr`` respectively. Apr 12 07:32:59 user devstack@n-api.service[72696]: ). Its value may be silently ignored in the future. Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 07:32:59 user devstack@n-api.service[72697]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 07:32:59 user devstack@n-api.service[72697]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 07:32:59 user devstack@n-api.service[72697]: and ``live_migration_inbound_addr`` respectively. Apr 12 07:32:59 user devstack@n-api.service[72697]: ). Its value may be silently ignored in the future. Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72695) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72696) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72697) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 07:32:59 user devstack@n-api.service[72695]: INFO dbcounter [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Registered counter for database nova_api Apr 12 07:32:59 user devstack@n-api.service[72696]: INFO dbcounter [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Registered counter for database nova_api Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_db.sqlalchemy.engines [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72695) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_db.sqlalchemy.engines [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72696) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writer thread running {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writer thread running {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72697]: INFO dbcounter [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Registered counter for database nova_api Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG nova.context [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27d09cc3-e598-49d1-9784-b0c83c8af98c(cell1) {{(pid=72695) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72697) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG nova.context [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27d09cc3-e598-49d1-9784-b0c83c8af98c(cell1) {{(pid=72696) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writer thread running {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72695]: INFO dbcounter [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72695]: INFO dbcounter [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Registered counter for database nova_cell1 Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72696]: INFO dbcounter [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72696]: INFO dbcounter [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Registered counter for database nova_cell1 Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_db.sqlalchemy.engines [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72695) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_db.sqlalchemy.engines [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72695) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writer thread running {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_db.sqlalchemy.engines [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72696) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writer thread running {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writer thread running {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_db.sqlalchemy.engines [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72696) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG nova.context [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),27d09cc3-e598-49d1-9784-b0c83c8af98c(cell1) {{(pid=72697) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:32:59 user devstack@n-api.service[72697]: INFO dbcounter [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72697]: INFO dbcounter [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Registered counter for database nova_cell1 Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72697) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writer thread running {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72695]: INFO dbcounter [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writer thread running {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: INFO dbcounter [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG oslo_db.sqlalchemy.engines [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72695) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writer thread running {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG oslo_db.sqlalchemy.engines [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72696) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writer thread running {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72697) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writer thread running {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72697]: INFO dbcounter [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Registered counter for database nova_cell0 Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72697) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 07:32:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writer thread running {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 07:32:59 user devstack@n-api.service[72695]: WARNING keystonemiddleware.auth_token [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72695]: WARNING keystonemiddleware.auth_token [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72696]: WARNING keystonemiddleware.auth_token [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72696]: WARNING keystonemiddleware.auth_token [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72697]: WARNING keystonemiddleware.auth_token [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72697]: WARNING keystonemiddleware.auth_token [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72695]: WARNING keystonemiddleware.auth_token [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72695]: WARNING keystonemiddleware.auth_token [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f240b7990 pid: 72695 (default app) Apr 12 07:33:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:33:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001534 Apr 12 07:33:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 07:33:00 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:33:00 user devstack@n-api.service[72696]: WARNING keystonemiddleware.auth_token [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72696]: WARNING keystonemiddleware.auth_token [None req-d400b39f-8b40-4f8e-acb5-40682c222032 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72697]: WARNING keystonemiddleware.auth_token [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 07:33:00 user devstack@n-api.service[72696]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f240b7990 pid: 72696 (default app) Apr 12 07:33:00 user devstack@n-api.service[72697]: WARNING keystonemiddleware.auth_token [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 07:33:00 user devstack@n-api.service[72697]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f240b7990 pid: 72697 (default app) Apr 12 07:35:07 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-aceea44c-a3dd-41b2-8030-45faf7744dcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001411 Apr 12 07:35:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-58a0ff8d-a410-4191-8fa1-68f62d105c88 admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-58a0ff8d-a410-4191-8fa1-68f62d105c88 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.374558 Apr 12 07:35:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 07:35:07 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002683 Apr 12 07:35:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:09 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:10 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-881da522-1c71-41bc-bdee-6efa81ac59ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "ram": 256}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-881da522-1c71-41bc-bdee-6efa81ac59ec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.316839 Apr 12 07:35:10 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:09 2023] POST /compute/v2.1/flavors => generated 405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5f920eb1-d98e-40a1-9837-5ab62b115f6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5f920eb1-d98e-40a1-9837-5ab62b115f6a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049176 Apr 12 07:35:10 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 07:35:10 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001288 Apr 12 07:35:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:12 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d0d15b1d-3ee0-4ed9-aa7d-f34815c11243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "ram": 512}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d0d15b1d-3ee0-4ed9-aa7d-f34815c11243 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080368 Apr 12 07:35:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:12 2023] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-eb7d4b2a-f500-4a0c-bd2a-4679c5d8ceb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-eb7d4b2a-f500-4a0c-bd2a-4679c5d8ceb4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029537 Apr 12 07:35:12 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 07:35:12 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001334 Apr 12 07:35:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e8282ea5-e1fd-402a-9246-1a112618654f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 1024, "name": "ds1G", "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e8282ea5-e1fd-402a-9246-1a112618654f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059043 Apr 12 07:35:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ad21a455-1920-4e6f-bf67-949c32b20f6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ad21a455-1920-4e6f-bf67-949c32b20f6d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028467 Apr 12 07:35:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 07:35:14 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001318 Apr 12 07:35:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-94a435d0-185e-45ef-be41-b96277bce9d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-94a435d0-185e-45ef-be41-b96277bce9d8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.098977 Apr 12 07:35:16 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f53b4755-d4cc-43c3-a17c-59cac854b473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f53b4755-d4cc-43c3-a17c-59cac854b473 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095505 Apr 12 07:35:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 07:35:16 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001333 Apr 12 07:35:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-af3fe08e-a076-44f9-bdd9-2e2f08fa4992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-af3fe08e-a076-44f9-bdd9-2e2f08fa4992 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073100 Apr 12 07:35:18 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:18 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026229 Apr 12 07:35:18 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 07:35:18 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b0a188f-df58-4f4c-9c2f-8b1978d324d1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001427 Apr 12 07:35:20 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9c58567e-e189-4f16-994c-77e4efa7d8e7 admin admin] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9c58567e-e189-4f16-994c-77e4efa7d8e7 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.071600 Apr 12 07:35:20 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 07:35:20 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:35:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004243 Apr 12 07:35:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:22 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:35:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1663ad10-e676-4fa1-9afd-c85975a112fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1663ad10-e676-4fa1-9afd-c85975a112fa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.333193 Apr 12 07:35:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:22 2023] POST /compute/v2.1/flavors => generated 400 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a5fbaf1d-cac6-473d-b3d0-a17cb3d96f74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a5fbaf1d-cac6-473d-b3d0-a17cb3d96f74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041319 Apr 12 07:35:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 07:35:22 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002300 Apr 12 07:35:24 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:24 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7936e138-11f2-4bb9-863b-35119c857ce1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7936e138-11f2-4bb9-863b-35119c857ce1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.089626 Apr 12 07:35:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:24 2023] POST /compute/v2.1/flavors => generated 403 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:24 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b5093290-ef42-4108-83fe-cf0ba6ebfc10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:24 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b5093290-ef42-4108-83fe-cf0ba6ebfc10 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050527 Apr 12 07:35:24 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 07:35:24 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001286 Apr 12 07:35:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9eda8faf-3481-4f27-9654-df05682af66d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "ram": 4096, "disk": 40, "name": "m1.medium", "id": "3"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9eda8faf-3481-4f27-9654-df05682af66d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080816 Apr 12 07:35:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:26 2023] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4cf1e732-9b11-4ec3-91e8-13645a789460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4cf1e732-9b11-4ec3-91e8-13645a789460 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023510 Apr 12 07:35:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 07:35:26 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:28 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:28 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001337 Apr 12 07:35:28 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:35:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-888d0de5-eeb7-4d74-afcf-41c54dc9d57d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "swap": 0, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-888d0de5-eeb7-4d74-afcf-41c54dc9d57d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058644 Apr 12 07:35:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:28 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:28 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-2704929f-1379-4332-b3fe-12985e1c8b5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:28 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-2704929f-1379-4332-b3fe-12985e1c8b5a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023742 Apr 12 07:35:28 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 07:35:28 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:35:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:35:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001333 Apr 12 07:35:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 07:35:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:35:30 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-31af62c0-73f2-487c-b52f-c580bb889799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:30 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-31af62c0-73f2-487c-b52f-c580bb889799 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059686 Apr 12 07:35:30 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 07:35:30 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:35:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-7283f863-13f1-4eb1-a1de-e7c6ab2b4a9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:35:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-7283f863-13f1-4eb1-a1de-e7c6ab2b4a9a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025956 Apr 12 07:35:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 07:35:30 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:36:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c74941a-2389-4d1b-acd7-8b392d54655d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001608 Apr 12 07:36:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 07:36:01 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:36:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:36:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.090024 Apr 12 07:36:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 07:36:01 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:36:34 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-7283f863-13f1-4eb1-a1de-e7c6ab2b4a9a admin admin] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:34 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-7283f863-13f1-4eb1-a1de-e7c6ab2b4a9a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001370 Apr 12 07:36:34 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 07:36:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:36:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:36:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5df69cd7-aaea-4039-8541-043e1028b62b admin admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5df69cd7-aaea-4039-8541-043e1028b62b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.080421 Apr 12 07:36:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 07:36:34 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:36:38 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001607 Apr 12 07:36:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 07:36:38 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:36:38 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:36:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9ff28bb2-6b0e-4649-b724-2d6c0e98f730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "42", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.nano", "ram": 128}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:36:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9ff28bb2-6b0e-4649-b724-2d6c0e98f730 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063781 Apr 12 07:36:38 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 07:36:38 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:36:38 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5f359f9e-8ddd-4d6e-8c57-3f4bec1bc57c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:36:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5f359f9e-8ddd-4d6e-8c57-3f4bec1bc57c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033041 Apr 12 07:36:38 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 07:36:38 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:36:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:36:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-46399575-761c-4994-b97b-1fcacdbbeddb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001448 Apr 12 07:36:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 07:36:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:36:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-5e6e7232-0abb-4cee-89c8-a019881c2ba7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "swap": 0, "disk": 1, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:36:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-5e6e7232-0abb-4cee-89c8-a019881c2ba7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068056 Apr 12 07:36:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 07:36:42 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:36:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-86dba284-8790-4247-8994-183f64e2f125 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:36:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-86dba284-8790-4247-8994-183f64e2f125 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026260 Apr 12 07:36:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 07:36:42 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:38:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:38:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:38:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:38:56 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-99a3870a-2373-402d-9920-3bde5b69e04b tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Action: 'create', calling method: .version_select at 0x7f7c06271bd0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1921712366", "metadata": {"Type": "work"}}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:38:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-99a3870a-2373-402d-9920-3bde5b69e04b tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.815979 Apr 12 07:38:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 07:38:56 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1818 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 07:38:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:38:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fc819cd5-5732-4af6-8c84-bc2dc4634760 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c06195a20>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:38:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fc819cd5-5732-4af6-8c84-bc2dc4634760 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 200 len: 354 microversion: 2.1 time: 0.245192 Apr 12 07:38:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:38:57 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:38:58 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:38:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1131cad6-c6ab-453b-adf5-28560caff5ae tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c06172f80>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:38:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-1131cad6-c6ab-453b-adf5-28560caff5ae tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 200 len: 354 microversion: 2.1 time: 0.185174 Apr 12 07:38:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:38:58 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:38:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-71eeb09f-051d-4292-975c-b3bb048e007a tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c0601ce50>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:38:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-71eeb09f-051d-4292-975c-b3bb048e007a tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 202 len: 0 microversion: 2.1 time: 0.111488 Apr 12 07:38:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 07:38:58 2023] DELETE /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:38:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-77ef2a4b-27ca-4c63-8ec2-c61505ea8a37 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c06017760>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:38:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-77ef2a4b-27ca-4c63-8ec2-c61505ea8a37 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 200 len: 353 microversion: 2.1 time: 0.055701 Apr 12 07:38:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:38:58 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:38:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3680ddaa-9f6c-4abe-b832-4e31f6180307 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c0600aef0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:38:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3680ddaa-9f6c-4abe-b832-4e31f6180307 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 200 len: 353 microversion: 2.1 time: 0.064304 Apr 12 07:38:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:38:59 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-93056d33-fed3-4d8e-8aca-140acd21468c tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c0636b880>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-93056d33-fed3-4d8e-8aca-140acd21468c tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 200 len: 353 microversion: 2.1 time: 0.059947 Apr 12 07:39:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:39:00 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0f939144-b594-4596-bca0-91a9ef2673d6 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Calling method '.version_select at 0x7f7c06017e20>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-0f939144-b594-4596-bca0-91a9ef2673d6 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] HTTP exception thrown: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. Apr 12 07:39:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0f939144-b594-4596-bca0-91a9ef2673d6 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Request method failure captured: Apr 12 07:39:01 user devstack@n-api.service[72695]: request: GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed HTTP/1.1 Apr 12 07:39:01 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:39:01 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:39:01 user devstack@n-api.service[72695]: Connection: close Apr 12 07:39:01 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:39:01 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:39:01 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:39:01 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:39:01 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAQAq9IHvY-cs-GkIGxlnammXluOhRaLI3V1dU1nzSEsENlnckCUHoTTTN9x8--CT87pBD6_59TAUsZKGqtAXCcMct_o5PbqntFaKFhOHhSgPYW5cSXCjySfgMJFDmj5nlm3G6xV9kTbYefXSWFLrKh2pgI48cqyBb5gNUP-1KeV4E Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Project-Id: 5b78e25ec0ca4a8a9f545231596be4a9 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesGetTestJSON-469647947 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b78e25ec0ca4a8a9f545231596be4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b78e25ec0ca4a8a9f545231596be4a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b78e25ec0ca4a8a9f545231596be4a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesGetTestJSON-469647947 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Tenant-Id: 5b78e25ec0ca4a8a9f545231596be4a9 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesGetTestJSON-469647947 Apr 12 07:39:01 user devstack@n-api.service[72695]: X-User: tempest-VolumesGetTestJSON-469647947-project-member Apr 12 07:39:01 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:39:01 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:39:01 user devstack@n-api.service[72695]: X-User-Id: 64211a5633654495991e581f7592a70d Apr 12 07:39:01 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesGetTestJSON-469647947-project-member Apr 12 07:39:01 user devstack@n-api.service[72695]: method: Apr 12 07:39:01 user devstack@n-api.service[72695]: exception: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. Apr 12 07:39:01 user devstack@n-api.service[72695]: action_args: {'id': 'd5e9c683-7146-48f5-952f-2ba840fda8ed'} Apr 12 07:39:01 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. (HTTP 404) (Request-ID: req-1c2ebb2c-3059-4ee4-ae10-d703c6f19648) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. Apr 12 07:39:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:39:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0f939144-b594-4596-bca0-91a9ef2673d6 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] Returning 404 to user: Volume d5e9c683-7146-48f5-952f-2ba840fda8ed could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:39:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0f939144-b594-4596-bca0-91a9ef2673d6 tempest-VolumesGetTestJSON-469647947 tempest-VolumesGetTestJSON-469647947-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed" status: 404 len: 109 microversion: 2.1 time: 0.059783 Apr 12 07:39:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:39:01 2023] GET /compute/v2.1/os-volumes/d5e9c683-7146-48f5-952f-2ba840fda8ed => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:39:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-347260054", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "4b28a8fe-8f70-45e5-90c6-5794f01e492a"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:11 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] validate_networks() for [('4b28a8fe-8f70-45e5-90c6-5794f01e492a', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ee13201f-b1ea-4f5d-912b-08f3da0cb7aa tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: .version_select at 0x7f7c0601cc10>, body: {"keypair": {"name": "tempest-keypair-562229555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtYIE1iQ1eOzq8TbWffOnB7vReO1HMlrUa07uZ8/9yBlzZKxBzh+gxu+j4nEbBIwhEofCGzzxNWuCrc+SQ2dmq8ig+vw5FntmhOM9iHyuko9X/9YHHcTwmQ7BbS/rb9sw=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:13 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-ee13201f-b1ea-4f5d-912b-08f3da0cb7aa tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:13 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-ee13201f-b1ea-4f5d-912b-08f3da0cb7aa tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-ee13201f-b1ea-4f5d-912b-08f3da0cb7aa tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154957 Apr 12 07:39:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:13 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Getting quotas for project 4a1237d4763c436fbbeaf03fad8ee570. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Getting quotas for user b9da4c1fc6e54f7a8c780f9450b9f826 and project 4a1237d4763c436fbbeaf03fad8ee570. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b219b13e-7e81-42be-aead-71bf517e5246 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.379204 Apr 12 07:39:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 3381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-da8048e0-9a65-42f3-b24d-d26e19252d98 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-da8048e0-9a65-42f3-b24d-d26e19252d98 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:14 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-da8048e0-9a65-42f3-b24d-d26e19252d98 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4c1fc6e54f7a8c780f9450b9f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1237d4763c436fbbeaf03fad8ee570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-da8048e0-9a65-42f3-b24d-d26e19252d98 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 200 len: 1208 microversion: 2.1 time: 0.202204 Apr 12 07:39:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:14 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:17 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-661f6a78-ed8f-4579-94e8-0f28798cc4ad tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: .version_select at 0x7f7c06079900>, body: {"keypair": {"name": "tempest-keypair-1283331574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWy2c73nGoP9wRV2xfKGrxyBPnsIvknXQWRCIYcMCSDU05fzewwBgyWvBJq1u0MvvAKEyi3KpY/tzgFXrHMPriTb6ZMtivdmV/XZ3YuVnv2bDMJYGwMtp7eSZAEF48lbg=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:17 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-661f6a78-ed8f-4579-94e8-0f28798cc4ad tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for project f7915d29fb124c838093eba0ee6cb69c. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:17 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-661f6a78-ed8f-4579-94e8-0f28798cc4ad tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for user a555fa5e6680420e80fcc925a7540806 and project f7915d29fb124c838093eba0ee6cb69c. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-661f6a78-ed8f-4579-94e8-0f28798cc4ad tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230791 Apr 12 07:39:17 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:19 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-593219528", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:19 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] validate_networks() for [('44ded1bd-af51-4bee-bb78-604e95e530cf', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:19 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6d9eb0f0-25ce-4a2e-affa-a1e41795bc37 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'create', calling method: .version_select at 0x7f7c0606dd80>, body: {"keypair": {"name": "tempest-keypair-777808843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqw+fRFEXzo2E8zYD8tNpcWZ3Dbiukx9cAFsZUU+hROJOSEqpmsx5UgbhAUOur9dqTbsQ7BQg01ufaydX8WNt+5So3ZMdUF8LLxFa/deh6yQ8CHMyjzOmnF4ex9Z+eEQQ=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:19 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-6d9eb0f0-25ce-4a2e-affa-a1e41795bc37 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting quotas for project bc3578114ca9476ca280abc2e4f83b11. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:19 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-6d9eb0f0-25ce-4a2e-affa-a1e41795bc37 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting quotas for user b3d67cdd754c467dbe2760ede6f4218d and project bc3578114ca9476ca280abc2e4f83b11. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6d9eb0f0-25ce-4a2e-affa-a1e41795bc37 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.223549 Apr 12 07:39:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 21/58] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting quotas for project 2b1ea22b656f42ab9e8d117b0ff11b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting quotas for user 4b61df1643964059b70eba466af4b6db and project 2b1ea22b656f42ab9e8d117b0ff11b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:20 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-db506297-edb8-41e5-a5ed-d5fec32e750e tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.594026 Apr 12 07:39:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2c10f275-f9b9-4417-8c57-32b22e0ebd43 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:20 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2c10f275-f9b9-4417-8c57-32b22e0ebd43 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:20 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2c10f275-f9b9-4417-8c57-32b22e0ebd43 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2c10f275-f9b9-4417-8c57-32b22e0ebd43 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1210 microversion: 2.1 time: 0.179241 Apr 12 07:39:20 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:20 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2004380288", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "af815a31-5dc3-45af-a83e-9a4374f8315f"}], "security_groups": [{"name": "tempest-securitygroup--119662826"}], "key_name": "tempest-keypair-562229555", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-226648607", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:21 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] validate_networks() for [('af815a31-5dc3-45af-a83e-9a4374f8315f', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:21 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] validate_networks() for [('0ce68a1e-e059-45d3-85f8-0efaeaf88149', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for user 86009132a34b466399da1701f47316d9 and project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-48afcbdb-2475-4986-9bfc-54325ce662ad tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.001322 Apr 12 07:39:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:21 2023] POST /compute/v2.1/servers => generated 381 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e9a9205e-091b-4ce6-9f88-498088fac398 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e9a9205e-091b-4ce6-9f88-498088fac398 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:22 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e9a9205e-091b-4ce6-9f88-498088fac398 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e9a9205e-091b-4ce6-9f88-498088fac398 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1215 microversion: 2.1 time: 0.102097 Apr 12 07:39:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:22 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-377191038", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:22 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] validate_networks() for [('0ce68a1e-e059-45d3-85f8-0efaeaf88149', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-74c3cb7c-481d-468d-93f9-0b44ad80513b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.621888 Apr 12 07:39:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 22/63] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:21 2023] POST /compute/v2.1/servers => generated 406 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:23 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0a98bfbb-c145-4dfe-8597-c18fdd27e8c2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:23 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0a98bfbb-c145-4dfe-8597-c18fdd27e8c2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:23 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-0a98bfbb-c145-4dfe-8597-c18fdd27e8c2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for user 86009132a34b466399da1701f47316d9 and project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0a98bfbb-c145-4dfe-8597-c18fdd27e8c2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1232 microversion: 2.1 time: 0.109190 Apr 12 07:39:23 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 22/64] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:23 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1232 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:23 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-28ebb084-b9d8-4e34-af4b-c2b1253a2c4a tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.281371 Apr 12 07:39:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:22 2023] POST /compute/v2.1/servers => generated 381 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bf59864d-8034-4d30-a111-484701479c11 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-bf59864d-8034-4d30-a111-484701479c11 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:24 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-bf59864d-8034-4d30-a111-484701479c11 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:24 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-bf59864d-8034-4d30-a111-484701479c11 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 200 len: 1215 microversion: 2.1 time: 0.134913 Apr 12 07:39:24 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:23 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1794309151", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26"}], "security_groups": [{"name": "tempest-securitygroup--781363618"}], "key_name": "tempest-keypair-1283331574", "user_data": "}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:25 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] validate_networks() for [('7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Creating event network-changed:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72696) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fc97cea9-ef81-45bd-85c0-809e006f7bfe req-624985b1-8357-475f-be02-3efaf08e87e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72696) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:25 user devstack@n-api.service[72696]: INFO nova.compute.rpcapi [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 07:39:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] Releasing lock "compute-rpcapi-router" {{(pid=72696) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 07:39:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4b783509-4fe7-4e3d-ae5e-ce6752543204 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346131 Apr 12 07:39:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for project f7915d29fb124c838093eba0ee6cb69c. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for user a555fa5e6680420e80fcc925a7540806 and project f7915d29fb124c838093eba0ee6cb69c. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:27 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-91b07ea0-18f9-428f-b2eb-47e5ad40e4ed tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 3.135404 Apr 12 07:39:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:24 2023] POST /compute/v2.1/servers => generated 399 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f9dddf38-7931-498d-b702-80265744666b tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:27 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f9dddf38-7931-498d-b702-80265744666b tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-2050028382", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "d06c5fb1-62e9-426f-a223-7b4e4a89be8c"}], "security_groups": [{"name": "tempest-securitygroup--2059668258"}], "key_name": "tempest-keypair-777808843", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:27 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-f9dddf38-7931-498d-b702-80265744666b tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f9dddf38-7931-498d-b702-80265744666b tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1232 microversion: 2.1 time: 0.206161 Apr 12 07:39:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 24/69] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:27 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1232 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:27 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] validate_networks() for [('d06c5fb1-62e9-426f-a223-7b4e4a89be8c', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting quotas for project bc3578114ca9476ca280abc2e4f83b11. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Getting quotas for user b3d67cdd754c467dbe2760ede6f4218d and project bc3578114ca9476ca280abc2e4f83b11. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:29 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-69a78734-5b5a-4fd8-a6e1-697cf19f0fdc tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.797467 Apr 12 07:39:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-af8c7542-e560-4478-b6c3-be5217e390c0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:29 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-af8c7542-e560-4478-b6c3-be5217e390c0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:29 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-af8c7542-e560-4478-b6c3-be5217e390c0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-af8c7542-e560-4478-b6c3-be5217e390c0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1239 microversion: 2.1 time: 0.166282 Apr 12 07:39:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:29 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1239 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Creating event network-changed:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72695) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c20ef6d5-29ee-48f1-bf30-68c848831f88 req-c6174e3c-1d24-4d7a-9282-9fd16a7b2333 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72695) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:29 user devstack@n-api.service[72695]: INFO nova.compute.rpcapi [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 07:39:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] Releasing lock "compute-rpcapi-router" {{(pid=72695) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 07:39:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-acf4157d-c0d2-463e-b4b5-8c3f76126344 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197660 Apr 12 07:39:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] Creating event network-changed:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:39:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-bdb2a721-eb97-413d-a389-e8e624590b54 req-d6332a37-d5f6-4d4b-86d2-14bda27bed6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135324 Apr 12 07:39:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "name": "network-vif-plugged", "status": "completed", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Creating event network-vif-plugged:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72697) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-838b5589-ba10-4b22-bb4a-f99e94a4b9fe req-19fffc16-bf83-4056-9c8b-749924f1892c service nova] Acquired lock "compute-rpcapi-router" {{(pid=72697) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:32 user devstack@n-api.service[72697]: INFO nova.compute.rpcapi [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 07:39:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45527681-91c2-4542-a096-1a741530bce5 None None] Releasing lock "compute-rpcapi-router" {{(pid=72697) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 07:39:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-45527681-91c2-4542-a096-1a741530bce5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129089 Apr 12 07:39:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] Creating event network-changed:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:39:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-8d77fba9-6e4d-4edc-ba75-c58223e52055 req-770494a6-f6d4-4688-b5b1-d336394c2d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045325 Apr 12 07:39:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "name": "network-vif-plugged", "status": "completed", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] Creating event network-changed:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:39:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-01e52114-5ec4-4877-8a4a-4bd9bfd376fe req-833b159c-dc5d-4ca3-a365-1990b7695252 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045029 Apr 12 07:39:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] Creating event network-vif-plugged:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:39:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-60806fbc-5d65-4de7-aa27-917e7a467678 req-2b6a3f0f-c900-4fdc-bf4e-cd1c922ac584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078247 Apr 12 07:39:34 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}, {"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "name": "network-vif-plugged", "status": "completed", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:39:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:39:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a3d033b7-6b46-4fb7-ba13-e7c97d57fad7 req-4a20a9e6-c603-4077-b3fb-040356f8dd60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057379 Apr 12 07:39:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] Creating event network-vif-plugged:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:39:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0c3a1e36-18d3-4256-9dc4-f1eb8b397609 req-bf5a51a9-78e5-4a9e-bdc2-cea5092841bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085433 Apr 12 07:39:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] Creating event network-changed:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:39:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-097d74c4-fea3-4aa5-be4c-cbae2c9ad531 req-19fedee3-3af2-4abd-b203-e840e4f82da9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056418 Apr 12 07:39:37 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}, {"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:38 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=16 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:39:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:39:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-82c78911-a675-4fb6-a2ab-74273c93fdb8 req-bf6e7090-4017-49d5-94bb-c614e9eb6d6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092281 Apr 12 07:39:38 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:38 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "name": "network-vif-plugged", "status": "completed", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}, {"name": "network-changed", "server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Creating event network-vif-plugged:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:39:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] Creating event network-changed:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:39:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-179d811b-6a07-40ae-91fa-bec9a6709328 req-071d7f2b-2010-43eb-8d78-ee515f57afc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038607 Apr 12 07:39:38 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:40 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=22 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:40 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:39:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-cc7e2e53-f8ed-4c7d-b749-57e550129b69 req-630879f5-8cb1-45a4-b4dc-fc07a47e4d35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107089 Apr 12 07:39:40 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:42 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:39:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7c307a8c-e508-4acc-bbf4-c2bf09290cf2 req-4d7ad0b3-dbbb-4f59-9d4d-219ffc60dc0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076691 Apr 12 07:39:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:42 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=12 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:42 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=30 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-44ed9c9c-3115-4c64-a8bc-4350e808f43c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Action: 'create', calling method: .version_select at 0x7f7c060de950>, body: {"keypair": {"name": "tempest-keypair-1332528006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuq866s8odsIKE37byvvUyVR3YuvoZgZXYSLaRELlwoAt9hhpQPlm37tUV+pXMWu8zJzK90JzS8xUWF9C/JZP8a9zHIGWrSX9Qk3HRbCHg72zVGm71AkqUtFO0R5xTNFQ=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:42 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=15 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:43 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-44ed9c9c-3115-4c64-a8bc-4350e808f43c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting quotas for project 0e5fc0e264e047c1b874854907be678e. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:43 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-44ed9c9c-3115-4c64-a8bc-4350e808f43c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting quotas for user f9750ae336a14eb3b0bcc849aa67a026 and project 0e5fc0e264e047c1b874854907be678e. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-44ed9c9c-3115-4c64-a8bc-4350e808f43c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.323267 Apr 12 07:39:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=5 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:39:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-20fe974d-61f8-4ce8-88b9-36ad987bdbd4 req-55f5e9c5-5b87-4e19-93c1-4c1125b11146 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073959 Apr 12 07:39:43 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=15 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:39:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-6bb23d0e-9a1c-4e7d-997a-33c87d2c0273 req-0b6e4e6d-9bc1-4499-af39-a617fb3a95e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085904 Apr 12 07:39:45 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:45 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=23 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:39:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-a59b8428-320f-4027-a418-7a44c53e5c92 req-ab149782-8fc2-4c07-975f-6831ba373586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064547 Apr 12 07:39:45 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 29/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-121117445", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "98796542-8a8f-40fb-88df-0af563000659"}], "security_groups": [{"name": "tempest-securitygroup--1820042596"}], "key_name": "tempest-keypair-1332528006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:47 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] validate_networks() for [('98796542-8a8f-40fb-88df-0af563000659', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:39:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-0da2d7f6-2fc4-4395-8a86-78dd862b24ea req-8a0cd2e2-f406-4f81-a3dc-064d71ad01b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072114 Apr 12 07:39:48 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting quotas for project 0e5fc0e264e047c1b874854907be678e. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Getting quotas for user f9750ae336a14eb3b0bcc849aa67a026 and project 0e5fc0e264e047c1b874854907be678e. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:48 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4eab4914-4a50-41e0-9ad5-69c1302df24b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.066615 Apr 12 07:39:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:49 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-686a347d-238d-4988-bafc-f87769aec2fe tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:49 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-686a347d-238d-4988-bafc-f87769aec2fe tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:49 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-686a347d-238d-4988-bafc-f87769aec2fe tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9750ae336a14eb3b0bcc849aa67a026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5fc0e264e047c1b874854907be678e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:49 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-686a347d-238d-4988-bafc-f87769aec2fe tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d" status: 200 len: 1225 microversion: 2.1 time: 0.350498 Apr 12 07:39:49 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 30/91] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:49 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d => generated 1225 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:52 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6e6764cd-a35d-4750-834a-ad41798b1579 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Action: 'create', calling method: .version_select at 0x7f7c05fd2560>, body: {"keypair": {"name": "tempest-keypair-827036857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrg4uHMBkAMw3UoqXTbvqnDFv+1eFvHSIxqnyVVNp9NtV1YTHEmXxQnYA72VxlIYNV/oW5eS6gzorv3tPjOcZ97EcXqfkecc1MgFQlMPDaeUsR9Ha/s9A4emn7MslwQtw=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:52 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-6e6764cd-a35d-4750-834a-ad41798b1579 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:52 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-6e6764cd-a35d-4750-834a-ad41798b1579 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for user 8de4929e67ed472b90e95066b2c50340 and project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6e6764cd-a35d-4750-834a-ad41798b1579 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.372854 Apr 12 07:39:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 32/92] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:51 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b610d354-f769-43d2-aab2-42f1ed916997 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Action: 'create', calling method: .version_select at 0x7f7c05f92b90>, body: {"keypair": {"name": "tempest-keypair-544690587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSo+xJ1Ypi/Tn3NVpQ8JFU2fNa56uTK1c2zwnyDeM+uMGnGtnkhQ+lcILpoFAYfMPXEx1tpwe6kyXYXXCsyys+C2aJZTJV4S0el56kXavyo3Z/5n3oYmsjnpinGcN0Kg=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:55 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-b610d354-f769-43d2-aab2-42f1ed916997 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting quotas for project a790f72405ee4b4ca977ba829dbd8971. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:55 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-b610d354-f769-43d2-aab2-42f1ed916997 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting quotas for user 0082023d624048c796622b4142d89ab6 and project a790f72405ee4b4ca977ba829dbd8971. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b610d354-f769-43d2-aab2-42f1ed916997 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.116527 Apr 12 07:39:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 31/93] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 07:39:55 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 07:39:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] Creating event network-changed:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:39:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-db233a94-d84e-4f06-8db5-82d73d2346da req-b641534c-ebca-41b3-9fd9-04e89534fea5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088568 Apr 12 07:39:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1359303190", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "794c3330-22fe-49a1-a6ed-46aac1833b26"}], "security_groups": [{"name": "tempest-securitygroup--536951683"}], "key_name": "tempest-keypair-827036857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:57 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] validate_networks() for [('794c3330-22fe-49a1-a6ed-46aac1833b26', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-95dc4e8a-4f45-47d6-b85f-4feca8771145 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Action: 'create', calling method: .version_select at 0x7f7c05fac430>, body: {"keypair": {"name": "tempest-keypair-1375571147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGwHDucxhfjXyaWw5D2kxH8A4L6D9HQliW9y3ojju8EU9ZXEg3SpzTGASkavRgR8pe9xIAbGFPQVL37SmYxaD49MN9pk/kPq0XfH/d08Jmy/UlGf4WQY+n1rtDufliS0w=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:57 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-95dc4e8a-4f45-47d6-b85f-4feca8771145 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting quotas for project 9a7b4669bf684bdaa24332f6821c7186. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:57 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-95dc4e8a-4f45-47d6-b85f-4feca8771145 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting quotas for user 4a1945c498db466dba6c16af19ff42d0 and project 9a7b4669bf684bdaa24332f6821c7186. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-95dc4e8a-4f45-47d6-b85f-4feca8771145 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.335870 Apr 12 07:39:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 32/95] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:39:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for user 8de4929e67ed472b90e95066b2c50340 and project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-af0b2157-bab4-4000-8120-1225d8475ddf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.517897 Apr 12 07:39:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 33/96] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:39:57 2023] POST /compute/v2.1/servers => generated 403 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:39:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d67ebf90-0c52-489a-81c0-e5ecdd02933e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d67ebf90-0c52-489a-81c0-e5ecdd02933e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:39:58 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-d67ebf90-0c52-489a-81c0-e5ecdd02933e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:39:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1072053691", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7fbf619a-2a3b-4997-ab96-250c026d9f8e"}], "security_groups": [{"name": "tempest-securitygroup--1399686653"}], "key_name": "tempest-keypair-544690587", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d67ebf90-0c52-489a-81c0-e5ecdd02933e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614" status: 200 len: 1235 microversion: 2.1 time: 0.196480 Apr 12 07:39:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:39:58 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 => generated 1235 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "name": "network-vif-plugged", "status": "completed", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] Creating event network-vif-plugged:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:39:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-f0851bf3-5e23-41c2-ae12-a0f599db1176 req-c59fc946-6cd1-42da-a9d9-e46dfb988300 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046860 Apr 12 07:39:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:39:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=16 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] validate_networks() for [('7fbf619a-2a3b-4997-ab96-250c026d9f8e', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting quotas for project a790f72405ee4b4ca977ba829dbd8971. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Getting quotas for user 0082023d624048c796622b4142d89ab6 and project a790f72405ee4b4ca977ba829dbd8971. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:39:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:39:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-5c5d71d9-2f4a-4ad8-b93f-c61dd991d433 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.065207 Apr 12 07:39:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 33/99] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 07:39:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:39:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:39:59 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:00 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:00 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:00 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-48028cad-b5e2-4e94-bf8a-df3c09d2a536 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 200 len: 1320 microversion: 2.49 time: 0.321083 Apr 12 07:40:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 33/100] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:39:59 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:40:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-977931869", "imageRef": "e37a17a0-55cd-4c56-a320-ff10e65f48f7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7ba1738b-ea57-4e2c-a0a1-578ae35f420f"}], "security_groups": [{"name": "tempest-securitygroup--2052326191"}], "key_name": "tempest-keypair-1375571147", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:00 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] validate_networks() for [('7ba1738b-ea57-4e2c-a0a1-578ae35f420f', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:40:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "name": "network-vif-plugged", "status": "completed", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] Creating event network-vif-plugged:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:40:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-35a4ebf2-9aa0-4a58-98f4-39f87063edb3 req-bf740e14-848c-4b57-bb7d-fbea0cc78368 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043842 Apr 12 07:40:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting quotas for project 9a7b4669bf684bdaa24332f6821c7186. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Getting quotas for user 4a1945c498db466dba6c16af19ff42d0 and project 9a7b4669bf684bdaa24332f6821c7186. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:40:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e37a17a0-55cd-4c56-a320-ff10e65f48f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:40:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e7fa301d-868f-457c-98db-464b63455af7 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.805462 Apr 12 07:40:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 35/102] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:40:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:40:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a69ee7e9-af6c-4132-ada5-14757d763671 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:01 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a69ee7e9-af6c-4132-ada5-14757d763671 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:01 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-a69ee7e9-af6c-4132-ada5-14757d763671 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1945c498db466dba6c16af19ff42d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7b4669bf684bdaa24332f6821c7186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-a69ee7e9-af6c-4132-ada5-14757d763671 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 200 len: 1239 microversion: 2.1 time: 0.122376 Apr 12 07:40:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:01 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 1239 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] Creating event network-changed:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:40:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-bc419463-4421-410b-a0cc-e56df0f73c4d req-0bb917ff-585e-4432-a569-c8f73b33a595 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046114 Apr 12 07:40:02 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:03 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] Creating event network-changed:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:40:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-4c3d6e86-b942-46ed-a51a-ca0d680124f5 req-842041d9-c1cb-4f56-9206-916a9e13917b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039559 Apr 12 07:40:03 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "name": "network-vif-plugged", "status": "completed", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] Creating event network-vif-plugged:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-46965959-bc4f-4bf4-bdbe-1778f1c5f440 req-b2dd12d0-95e5-4894-8b2b-46b9bebba472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Apr 12 07:40:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:05 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4c1fc6e54f7a8c780f9450b9f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1237d4763c436fbbeaf03fad8ee570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-cf3fbee7-d8cc-4962-9dae-14b17b2419f9 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 200 len: 1487 microversion: 2.1 time: 0.533117 Apr 12 07:40:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:04 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 1487 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:06 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] Creating event network-changed:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:40:06 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a99a99e4-3212-4912-a3aa-e11b6f3a7d5b req-4f49ea3a-4566-403a-95ce-84a425320d86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027898 Apr 12 07:40:06 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:40:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "name": "network-vif-plugged", "status": "completed", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] Creating event network-vif-plugged:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:40:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c8325ea4-afd5-4f5c-bd62-29ee6e9140ff req-dbea1c15-8b29-41f9-8cf9-9675f97e83b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034013 Apr 12 07:40:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] Creating event network-vif-plugged:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:40:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-e527ef33-6176-45f1-8791-0853a7c69e74 req-2cb11cb9-d77d-427c-b4e4-017a0989af1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 Apr 12 07:40:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}, {"server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "name": "network-vif-plugged", "status": "completed", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Creating event network-vif-plugged:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:40:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] Creating event network-vif-plugged:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:40:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-68fe5a5f-e0fa-42c9-a0a8-4904c8f7859c req-354d9362-f291-4e56-b1b7-834eebd794b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068366 Apr 12 07:40:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:11 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4d051588-5aee-4cdd-9ff2-600979bfb365 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1492 microversion: 2.1 time: 0.397033 Apr 12 07:40:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:10 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1492 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=20 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "name": "network-vif-plugged", "status": "completed", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] Creating event network-vif-plugged:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:40:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-2740c824-c5b8-4241-a508-58a682783221 req-09559a99-4685-4267-929d-05736b3f7454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Apr 12 07:40:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=16 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=12 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:14 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d108a1c7-7a20-4c9d-96a1-57e6d41d0890 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1538 microversion: 2.1 time: 0.438279 Apr 12 07:40:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:13 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1538 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:14 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-471aee07-ef82-4144-b364-a8796b1f80cd tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 200 len: 1502 microversion: 2.1 time: 0.259426 Apr 12 07:40:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:14 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:18 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-fd09cfb6-50df-480d-9cfb-009207e1e825 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1536 microversion: 2.1 time: 0.275891 Apr 12 07:40:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:17 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1536 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:19 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4b3e54f3-a6c6-48b5-b683-9213451697a0 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1554 microversion: 2.1 time: 0.169928 Apr 12 07:40:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 40/117] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:19 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-66a2dfc4-c7eb-4998-944b-44a4b29fc5ef tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Action: 'create', calling method: .version_select at 0x7f7c057ab010>, body: {"keypair": {"name": "tempest-keypair-413750630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1qwPlAX5sw19G/mtRgNEZG+FAVrIXQlK6qQCRR1byY8+1gtB1nzjmt9FXf14nlan2MSD/2V/3+2uEzoMzes9ZMe54l3mAGPweUS79SmuBb03OnPxqZVsYsmB6eYaLiVg=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:27 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:27 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=19 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:27 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-66a2dfc4-c7eb-4998-944b-44a4b29fc5ef tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting quotas for project 7a14e30be0d8491a915bb08ed9d296ce. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:40:28 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-66a2dfc4-c7eb-4998-944b-44a4b29fc5ef tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting quotas for user b74586fa38f44010878c70a8e60395ae and project 7a14e30be0d8491a915bb08ed9d296ce. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:40:28 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-66a2dfc4-c7eb-4998-944b-44a4b29fc5ef tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.052486 Apr 12 07:40:28 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 39/118] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 07:40:27 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 07:40:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-30542415", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1287569d-de91-4614-b2fd-e17004f43121"}, {"port": "2817bde8-a488-48b9-a877-32abe9e58c2b", "tag": "port-1"}, {"port": "7522065e-41bf-4026-a63d-998d70579447", "tag": "port-2"}, {"uuid": "93f2a36f-5163-4e59-a2cb-3629202e80a5", "tag": "net-1"}, {"uuid": "93f2a36f-5163-4e59-a2cb-3629202e80a5"}, {"uuid": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "064c42bd-13dd-4650-ae07-2582fd96b4c8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "642e1f33-fca6-4bcd-8c1e-74088387ef60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8d9e2b9f-1085-4d1c-9637-d640e3136de3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c8669056-e4c7-4a8d-89e3-55640deee369", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--899664199"}], "key_name": "tempest-keypair-413750630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=22 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:29 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] validate_networks() for [('1287569d-de91-4614-b2fd-e17004f43121', None, None, None, None, None), (None, None, '2817bde8-a488-48b9-a877-32abe9e58c2b', None, None, None), (None, None, '7522065e-41bf-4026-a63d-998d70579447', None, None, None), ('93f2a36f-5163-4e59-a2cb-3629202e80a5', None, None, None, None, None), ('93f2a36f-5163-4e59-a2cb-3629202e80a5', None, None, None, None, None), ('064c42bd-13dd-4650-ae07-2582fd96b4c8', '10.2.2.100', None, None, None, None), ('064c42bd-13dd-4650-ae07-2582fd96b4c8', '10.2.2.200', None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting quotas for project 7a14e30be0d8491a915bb08ed9d296ce. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Getting quotas for user b74586fa38f44010878c70a8e60395ae and project 7a14e30be0d8491a915bb08ed9d296ce. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:40:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='642e1f33-fca6-4bcd-8c1e-74088387ef60',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8d9e2b9f-1085-4d1c-9637-d640e3136de3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8669056-e4c7-4a8d-89e3-55640deee369',volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:40:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1fb98e6f-406a-4021-a2b0-599ba604abe0 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.016985 Apr 12 07:40:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 40/119] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 07:40:29 2023] POST /compute/v2.1/servers => generated 403 bytes in 3019 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=24 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b0afd355-b5a5-4467-be4e-77c33ce9253a tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 200 len: 1277 microversion: 2.42 time: 0.071978 Apr 12 07:40:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:40:32 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 1277 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] Creating event network-changed:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f0840c82-59b9-4ec3-85b2-ef4b76ab9b99 req-be63dae5-1c78-4523-b697-5ce1c096b744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047187 Apr 12 07:40:38 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:39 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9750ae336a14eb3b0bcc849aa67a026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5fc0e264e047c1b874854907be678e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-075e1b12-fdeb-43e5-a2a4-05c16008feea tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d" status: 200 len: 1525 microversion: 2.1 time: 0.222339 Apr 12 07:40:39 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 41/122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:39 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d => generated 1525 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "2817bde8-a488-48b9-a877-32abe9e58c2b"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] Creating event network-changed:2817bde8-a488-48b9-a877-32abe9e58c2b for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a53707d7-db0d-4185-8a02-b191249ada2a req-7da9c775-c6af-4e1e-8ac9-eb34c9f48be9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035047 Apr 12 07:40:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "7522065e-41bf-4026-a63d-998d70579447"}, {"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}, {"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Creating event network-changed:7522065e-41bf-4026-a63d-998d70579447 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Creating event network-changed:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] Creating event network-changed:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-1ad32cfa-7c5b-46f3-9e7c-3373e473cffb req-b7a493a7-4796-499e-9df6-d75655223feb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.036368 Apr 12 07:40:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}, {"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Creating event network-changed:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] Creating event network-changed:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a3f34c89-d626-4797-8007-f0d84c1ed0bc req-3eec462a-bd82-451d-82d9-25a4d94b58e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036641 Apr 12 07:40:45 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:48 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-480e900c-3891-44b9-956a-868e44a60faf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614" status: 200 len: 1544 microversion: 2.1 time: 0.139884 Apr 12 07:40:48 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:48 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:50 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c679bd84-128e-470a-a39c-11c1c85588b9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 200 len: 1625 microversion: 2.49 time: 0.298257 Apr 12 07:40:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 42/127] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:40:50 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 1625 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:51 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1945c498db466dba6c16af19ff42d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7b4669bf684bdaa24332f6821c7186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:40:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8a67e3fb-e947-47e0-af7e-67c25ef1f743 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 200 len: 1547 microversion: 2.1 time: 0.146265 Apr 12 07:40:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 43/128] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:40:51 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:40:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] Creating event network-vif-plugged:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7788f446-3048-4299-87f4-000e8da741a2 req-64393218-8dd5-4a1a-8000-5a85815cab3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Apr 12 07:40:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] Creating event network-vif-plugged:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-53de0432-969c-4fbc-85fa-e11fcef614c6 req-efa03768-0fa8-455f-9436-2cff1bb08162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Apr 12 07:40:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] Creating event network-vif-plugged:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f1169d1a-e3a1-404b-8f43-3073d72ea8b7 req-c3c9d004-c4a9-45a3-8aed-63bbec5439e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066324 Apr 12 07:40:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:40:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "2817bde8-a488-48b9-a877-32abe9e58c2b"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "2817bde8-a488-48b9-a877-32abe9e58c2b"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "7522065e-41bf-4026-a63d-998d70579447"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "7522065e-41bf-4026-a63d-998d70579447"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:40:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:40:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:40:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Creating event network-vif-plugged:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Creating event network-vif-plugged:2817bde8-a488-48b9-a877-32abe9e58c2b for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Creating event network-vif-plugged:2817bde8-a488-48b9-a877-32abe9e58c2b for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Creating event network-vif-plugged:7522065e-41bf-4026-a63d-998d70579447 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] Creating event network-vif-plugged:7522065e-41bf-4026-a63d-998d70579447 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:40:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-1830cd70-097f-47e0-af5b-94252b15ac61 req-44a2bdb2-0a2d-46a6-8460-c055437393b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.045726 Apr 12 07:40:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Creating event network-vif-plugged:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Creating event network-vif-plugged:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Creating event network-vif-plugged:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Creating event network-vif-plugged:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] Creating event network-vif-plugged:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-6c9049c3-74bb-4593-bf06-2539c1c62602 req-35289b56-8c25-4388-9caa-5b84dcb3d6b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034176 Apr 12 07:41:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:00 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:01 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=19 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] Creating event network-vif-plugged:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:41:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-68c3e467-f62e-43af-a558-b2605b6cb788 req-dba08c31-22bb-494b-906d-153181211045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052456 Apr 12 07:41:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216d0338-4a75-49f0-96a4-7a7afd2a3176"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=13 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:06 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=13 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-920e6d9f-499a-4bc7-8999-d78b37bfcaa0 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538796 Apr 12 07:41:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 46/135] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:41:06 2023] POST /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=10 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=14 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-772784802", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:11 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] validate_networks() for [('44ded1bd-af51-4bee-bb78-604e95e530cf', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting quotas for project 2b1ea22b656f42ab9e8d117b0ff11b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Getting quotas for user 4b61df1643964059b70eba466af4b6db and project 2b1ea22b656f42ab9e8d117b0ff11b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:41:12 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:41:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-db331de1-ec87-4ee6-b077-8f488c2b2d72 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.694763 Apr 12 07:41:12 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 45/136] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:41:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:41:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7afda68b-1ce4-4edd-b444-6d6881b3eec4 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-7afda68b-1ce4-4edd-b444-6d6881b3eec4 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:12 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-7afda68b-1ce4-4edd-b444-6d6881b3eec4 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7afda68b-1ce4-4edd-b444-6d6881b3eec4 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 200 len: 1210 microversion: 2.1 time: 0.099607 Apr 12 07:41:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 46/137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:12 2023] GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-55ae27c5-b9a7-4cce-952c-1a34d6a73fec tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.200632 Apr 12 07:41:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 47/138] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:14 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-interface => generated 282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:14 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid acbd6126-210b-41cf-a994-528233e5369b {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:41:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-32205808-f59b-4f0b-9c03-a249045e5c37 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b/action" status: 200 len: 32 microversion: 2.1 time: 0.713231 Apr 12 07:41:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 46/139] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:41:14 2023] POST /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b/action => generated 32 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:41:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4ad4f1db-83ae-424e-9e72-ff6e22226197 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 204 len: 0 microversion: 2.1 time: 0.151407 Apr 12 07:41:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:41:15 2023] DELETE /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:15 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d57d1756-f7e2-4f02-827b-dd085f42c218 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 200 len: 1508 microversion: 2.1 time: 0.489167 Apr 12 07:41:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:15 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 1508 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9da4c1fc6e54f7a8c780f9450b9f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1237d4763c436fbbeaf03fad8ee570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-1ed263af-4ebd-4883-981d-da74fd852f58 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 200 len: 1539 microversion: 2.1 time: 0.714554 Apr 12 07:41:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:15 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 1539 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 07:41:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "name": "network-vif-unplugged", "status": "completed", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] Creating event network-vif-unplugged:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:41:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-99729f69-7631-4237-83bb-57370fb0b5f1 req-1d0a896c-8d5a-47c7-aa8a-0a107bc12a91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044131 Apr 12 07:41:16 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 49/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:16 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-fb7fd7cc-1334-4e4f-9213-f2871b332cf0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1538 microversion: 2.1 time: 0.306601 Apr 12 07:41:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:16 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1538 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:16 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-538a5515-f09e-49e4-bc20-24fc598df656 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1538 microversion: 2.1 time: 0.179026 Apr 12 07:41:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:16 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1538 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] Creating event network-changed:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:41:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-48d917ec-57f1-45cf-84d2-f74d18392d54 req-80687e18-124c-4ae4-8538-ee7fe5697428 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047525 Apr 12 07:41:18 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "name": "network-vif-plugged", "status": "completed", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}, {"name": "network-changed", "server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}, {"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-unplugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}, {"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Creating event network-vif-plugged:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:41:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Creating event network-changed:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:41:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Creating event network-vif-unplugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:41:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:41:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a098f8d1-e099-42bc-8aca-88890e5e07e0 req-71ed34fe-e4e9-4aab-925f-24ac36c69c75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.055362 Apr 12 07:41:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c8ff3a0a-59fc-43c9-a91c-3d65985cfbc9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091378 Apr 12 07:41:18 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:18 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-55647809-0340-4dde-975f-5747ce060b66 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/ips" status: 200 len: 103 microversion: 2.1 time: 0.045696 Apr 12 07:41:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 07:41:19 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/ips => generated 103 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-880e59d3-4ec9-4df3-b257-f352fc876f44 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.194825 Apr 12 07:41:20 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:20 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-interface => generated 283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f40c85d-313c-4485-8131-37d4c53441d7", "name": "network-vif-deleted", "tag": "5b484c80-547c-43a2-8b8b-432bc559c1fc"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] Creating event network-vif-deleted:5b484c80-547c-43a2-8b8b-432bc559c1fc for instance 4f40c85d-313c-4485-8131-37d4c53441d7 on user Apr 12 07:41:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-1234f496-c3f0-41e6-8b43-633b881eb945 req-fe657a17-ad0e-4152-a561-438f852e2789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051974 Apr 12 07:41:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}, {"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Creating event network-changed:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:41:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:41:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7ba6af97-e52f-47b7-ae93-9cfda6fff8d2 req-6afa50e8-4cb2-4ce3-a4e0-30cb85537b5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043717 Apr 12 07:41:20 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 52/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d264d7ac-e4d5-48b7-b5f8-11b463caef9f"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9ec199d3-760e-4e6c-8a3f-a535aabca298 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331189 Apr 12 07:41:21 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 51/153] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:41:20 2023] POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1241257621"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "name": "network-vif-plugged", "status": "completed", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}, {"name": "network-changed", "server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Creating event network-vif-plugged:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:41:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] Creating event network-changed:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:41:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-6cc11193-32a7-43d6-b281-69da0d23cfd1 req-4f082c1a-fe7d-49f2-aa07-c258683e3a63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048221 Apr 12 07:41:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 53/154] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:41:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-8b43d254-c2a4-44d7-8fda-a2398fb050ec req-eeaf7ba0-cab5-468c-b5f3-5179414883ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041775 Apr 12 07:41:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 52/155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1841248973", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "66df63d5-6afc-456b-8e87-bfb37e26aeeb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:22 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:22 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:23 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:23 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-578de5b4-9ccb-4ef4-a344-94f2bd928842 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 200 len: 2822 microversion: 2.42 time: 0.276363 Apr 12 07:41:23 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:41:22 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 2822 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:41:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0bee9c0d-d131-47a7-90c8-6b76a4de7550 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action" status: 202 len: 0 microversion: 2.1 time: 0.955899 Apr 12 07:41:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:41:22 2023] POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:41:23 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b2c4e553-561d-494a-94bb-0089153e7902 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '.version_select at 0x7f7c05f93a30>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:41:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b2c4e553-561d-494a-94bb-0089153e7902 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170" status: 200 len: 1609 microversion: 2.1 time: 0.057532 Apr 12 07:41:23 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 07:41:23 2023] GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170 => generated 1609 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:41:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='66df63d5-6afc-456b-8e87-bfb37e26aeeb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:41:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e69564ce-7b2c-4391-bcc4-701dd1924424 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.886878 Apr 12 07:41:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 54/159] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:41:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:41:23 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b81f911c-fac8-4a06-a3d4-9f5e67935fe0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:23 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b81f911c-fac8-4a06-a3d4-9f5e67935fe0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-b81f911c-fac8-4a06-a3d4-9f5e67935fe0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b81f911c-fac8-4a06-a3d4-9f5e67935fe0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 200 len: 1052 microversion: 2.1 time: 0.078001 Apr 12 07:41:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 52/160] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:23 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 1052 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "name": "network-vif-plugged", "status": "completed", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] Creating event network-vif-plugged:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:41:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-53e51416-2b1d-4606-8ab4-899e7b89fb9a req-a0569582-861a-47ee-bb60-86189d743367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068130 Apr 12 07:41:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] Creating event network-changed:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:41:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7a696af0-89be-4137-8086-c24f60c172b7 req-e8acf3d4-5848-4f66-9f63-c3f3c59f8162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069097 Apr 12 07:41:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 55/162] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:30 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Going to try to stop instance {{(pid=72696) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 07:41:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5162bb08-cbd7-4a16-aff3-560089c59beb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.105665 Apr 12 07:41:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 53/163] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:41:30 2023] POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:30 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:30 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-23a00cc3-206a-49b2-b2b5-424553b6921e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1711 microversion: 2.1 time: 0.161699 Apr 12 07:41:30 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:41:30 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:41:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] Creating event network-vif-unplugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:41:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-eef5744e-e598-48a9-837c-c45cc39d151e req-5d35ef0b-4a54-4181-adbd-6e82cb5ada6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028129 Apr 12 07:41:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:41:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-b5f2536d-752d-4960-a6ab-c22a70ae3668 req-93d95308-8069-4b7b-b984-5bfdb0019ec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046881 Apr 12 07:41:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 54/166] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "name": "network-vif-plugged", "status": "completed", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] Creating event network-vif-plugged:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:41:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-dbc49299-f646-4255-a650-35f7ba75298e req-1a03a03d-0f11-4069-ba7f-7f15e25fa70b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051728 Apr 12 07:41:39 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 57/167] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a98e3eed-7445-41d8-be9b-d8b64e65430f tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.116214 Apr 12 07:41:39 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 57/168] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:39 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-interface => generated 283 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c6f68c-7746-42ac-ad97-9c6e35dcc9af"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:40 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3f2f53a2-b3e3-4eec-b331-ff6e09f36c2b tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320774 Apr 12 07:41:40 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 55/169] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:41:40 2023] POST /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "name": "network-vif-plugged", "status": "completed", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}, {"name": "network-changed", "server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Creating event network-vif-plugged:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:41:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] Creating event network-changed:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:41:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a4978e8c-9621-4713-b298-4f8ae7a3f8c9 req-b2863736-1a0c-4c23-b946-ac6ac3007cd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039053 Apr 12 07:41:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "af3e2849-ab76-4e11-b068-aa07f951ca6c"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:49 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:49 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5f601e8d-7087-425b-9e98-9abc2f7dcd95 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.121985 Apr 12 07:41:49 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 56/171] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:49 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-interface => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ca439f1f-a9c0-4f5d-ab93-0456cfda1bd1 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/31c6f68c-7746-42ac-ad97-9c6e35dcc9af" status: 202 len: 0 microversion: 2.1 time: 0.634194 Apr 12 07:41:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 58/172] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 07:41:48 2023] PUT /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/31c6f68c-7746-42ac-ad97-9c6e35dcc9af => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:41:49 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:50 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=28 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:50 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:41:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] Creating event network-changed:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:41:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-05ce3db9-b048-4efb-ae67-4954f8aa26cd req-b6d59cce-cc92-444a-a27c-a28dbfd993c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056432 Apr 12 07:41:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 59/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d18458a4-e478-48f4-9089-23b82473b225 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.127773 Apr 12 07:41:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 57/174] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 07:41:50 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd4dae4-e95c-4aa8-a784-6d5953d9f828"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] Creating event network-changed:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:41:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6a460179-fdad-4171-9d44-a24705c57630 req-91ebcbbc-622b-48cb-92e3-ab083387b255 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042266 Apr 12 07:41:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:41:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-848aad11-7b76-4fd0-a011-7e15553cd0cc tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317742 Apr 12 07:41:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 59/176] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:41:51 2023] POST /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8cbfde18-2880-45be-b23a-33619a06b4d5 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 200 len: 1625 microversion: 2.49 time: 0.208400 Apr 12 07:41:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 58/177] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:41:51 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 1625 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "39fc8c89-569f-4285-9e16-f09cdea47fa1", "tag": "nic-tag"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cf39fc43-f884-4d0f-a0e8-ecaaf4bf31ac tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150957 Apr 12 07:41:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:41:51 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-interface => generated 282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] Creating event network-changed:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:41:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-4a197316-46b7-4172-955f-2ff1d174b1bc req-28d1dc4c-5816-46a8-ba95-e2b1d7dcf055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092921 Apr 12 07:41:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 59/179] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c251c47-f086-40b0-ae27-a20206a4ffc5"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:54 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:54 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] Creating event network-changed:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:41:54 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-295f3ca3-bc58-444e-9127-718420b85680 req-94e368d3-9160-4e73-a5bd-24c6d9e49819 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031465 Apr 12 07:41:54 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:54 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-336e47bc-a252-4363-afb4-832cc5e30638 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305292 Apr 12 07:41:54 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:41:54 2023] POST /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] Creating event network-vif-plugged:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:41:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-b1ae31b7-afce-44d6-86d3-363c40f3db46 req-e0328448-3d2e-4e64-b58f-70f89e5bed42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031526 Apr 12 07:41:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9de91a83-bad5-4740-b50e-a98b62770a2b tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface" status: 200 len: 282 microversion: 2.49 time: 4.313184 Apr 12 07:41:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 61/183] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 07:41:51 2023] POST /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface => generated 282 bytes in 4315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6", "tag": "volume-tag"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a8608341-e0cd-4fb2-8803-c5b18bee35a9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.286707 Apr 12 07:41:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 62/184] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 07:41:56 2023] POST /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:41:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:41:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:41:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:41:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:41:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] Creating event network-vif-plugged:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:41:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-68dfd17e-65c6-44e3-b780-92b56ed136ce req-912b7b1e-6138-4f20-b6d8-de618e7c127e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044283 Apr 12 07:41:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "75ce95b0-b942-495d-8401-4e710ccfe63c"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] HTTP exception thrown: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Request method failure captured: Apr 12 07:42:01 user devstack@n-api.service[72697]: request: PUT /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments/ccd4dae4-e95c-4aa8-a784-6d5953d9f828 HTTP/1.1 Apr 12 07:42:01 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:42:01 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:42:01 user devstack@n-api.service[72697]: Connection: close Apr 12 07:42:01 user devstack@n-api.service[72697]: Content-Length: 74 Apr 12 07:42:01 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:42:01 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:42:01 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:42:01 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmBHpJqAS9HhTJNsoRxBAMPjatgZKxmTPUd07hMJc9vlfW5k2njeFRf2jIaCPMz9ijXwKfwkLhix4MKSZgpg_tnVLGEwGOV-0GAaaIwFVrhq_37otyQKd9ad-SzobAZimhH7by2MkUYgPUFpLyaTWRuvRw_oVObvAzOntD7AehgWZCU Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Project-Id: 644e093321884f69aa8cc2f21dbdbae4 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Role: admin,member,reader Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Roles: admin,member,reader Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Tenant: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Tenant-Id: 644e093321884f69aa8cc2f21dbdbae4 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-User: tempest-VolumesAdminNegativeTest-1506017688-project-admin Apr 12 07:42:01 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:42:01 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:42:01 user devstack@n-api.service[72697]: X-User-Id: d824602fce7043bc85f9ddf7950a0539 Apr 12 07:42:01 user devstack@n-api.service[72697]: X-User-Name: tempest-VolumesAdminNegativeTest-1506017688-project-admin Apr 12 07:42:01 user devstack@n-api.service[72697]: Apr 12 07:42:01 user devstack@n-api.service[72697]: {"volumeAttachment": {"volumeId": "75ce95b0-b942-495d-8401-4e710ccfe63c"}} Apr 12 07:42:01 user devstack@n-api.service[72697]: method: > Apr 12 07:42:01 user devstack@n-api.service[72697]: exception: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. Apr 12 07:42:01 user devstack@n-api.service[72697]: action_args: {'server_id': 'd4f9729d-3114-4fc6-a704-02f436c17614', 'id': 'ccd4dae4-e95c-4aa8-a784-6d5953d9f828', 'body': {'volumeAttachment': {'volumeId': '75ce95b0-b942-495d-8401-4e710ccfe63c'}}} Apr 12 07:42:01 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. (HTTP 404) (Request-ID: req-ad81744f-7334-4a2f-a267-20420d0a97bb) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. Apr 12 07:42:01 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Returning 400 to user: Volume 75ce95b0-b942-495d-8401-4e710ccfe63c could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-027cc85a-5e9c-4e99-b923-a47ca7d40dcd tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments/ccd4dae4-e95c-4aa8-a784-6d5953d9f828" status: 400 len: 107 microversion: 2.1 time: 0.285801 Apr 12 07:42:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 62/186] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 07:42:01 2023] PUT /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments/ccd4dae4-e95c-4aa8-a784-6d5953d9f828 => generated 107 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lazy-loading 'services' on Instance uuid d4f9729d-3114-4fc6-a704-02f436c17614 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:42:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3b8d6578-f751-4935-a979-cecb1bfdca9a tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments/ccd4dae4-e95c-4aa8-a784-6d5953d9f828" status: 202 len: 0 microversion: 2.1 time: 0.367979 Apr 12 07:42:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:42:01 2023] DELETE /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments/ccd4dae4-e95c-4aa8-a784-6d5953d9f828 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8743f4be-0dd6-416a-9093-662d6f08ef8d tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065234 Apr 12 07:42:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:01 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:02 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-70643aaa-8771-4cf7-bb8b-7034ee492845 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 200 len: 1492 microversion: 2.1 time: 0.145237 Apr 12 07:42:02 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:02 2023] GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 1492 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0a91a6e9-bd1e-43a5-ad52-36a1d853d560 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057115 Apr 12 07:42:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:04 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f1a071d5-945d-4418-aa64-73c53b7880a9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Apr 12 07:42:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:05 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "31c6f68c-7746-42ac-ad97-9c6e35dcc9af"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-25fc146a-09be-4b4f-995b-ab9195f3481f tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046450 Apr 12 07:42:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:05 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lazy-loading 'services' on Instance uuid 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:42:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-aba7ec4e-34a1-450f-945a-9f321eb79270 tempest-TestVolumeSwap-386478421 tempest-TestVolumeSwap-386478421-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/af3e2849-ab76-4e11-b068-aa07f951ca6c" status: 202 len: 0 microversion: 2.1 time: 0.295513 Apr 12 07:42:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 64/193] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 07:42:05 2023] PUT /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/af3e2849-ab76-4e11-b068-aa07f951ca6c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:42:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d85e3385-6cc8-4f71-b7a7-2a016dd47a75 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments/7c251c47-f086-40b0-ae27-a20206a4ffc5" status: 202 len: 0 microversion: 2.1 time: 0.277709 Apr 12 07:42:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:42:05 2023] DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments/7c251c47-f086-40b0-ae27-a20206a4ffc5 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:05 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a779200a-5200-4872-9376-374c9c0e632b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 200 len: 1488 microversion: 2.1 time: 0.174950 Apr 12 07:42:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:05 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 1488 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] HTTP exception thrown: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Request method failure captured: Apr 12 07:42:06 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 HTTP/1.1 Apr 12 07:42:06 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:42:06 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:42:06 user devstack@n-api.service[72697]: Connection: close Apr 12 07:42:06 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:42:06 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:42:06 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:42:06 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:42:06 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAfskLuRrF4wqnHpbrL2lRRLR1CrqaewCCh-pnYGo8DxWfWdCx33dL02HsTzo58XgJR2SZ-N8cHusy0BdaCmimfrTusPZuqymigr_aVGfbVQsRzO-VzmyJF_DF9jBb-GsOzWY-_4V8YTq4Kh0cXngb1LNnngHMHc2EdgoNHP2_ip4w Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Project-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Project-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Tenant: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Tenant-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-User: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:06 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:42:06 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:42:06 user devstack@n-api.service[72697]: X-User-Id: b9da4c1fc6e54f7a8c780f9450b9f826 Apr 12 07:42:06 user devstack@n-api.service[72697]: X-User-Name: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:06 user devstack@n-api.service[72697]: method: > Apr 12 07:42:06 user devstack@n-api.service[72697]: exception: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72697]: action_args: {'id': '4f40c85d-313c-4485-8131-37d4c53441d7'} Apr 12 07:42:06 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Returning 404 to user: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-09bf508a-bc98-4a25-adee-c183e155016b tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 404 len: 111 microversion: 2.1 time: 0.036471 Apr 12 07:42:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:06 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] HTTP exception thrown: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Request method failure captured: Apr 12 07:42:06 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7/os-volume_attachments HTTP/1.1 Apr 12 07:42:06 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:42:06 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:42:06 user devstack@n-api.service[72696]: Connection: close Apr 12 07:42:06 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:42:06 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:42:06 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:42:06 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:42:06 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAfskLuRrF4wqnHpbrL2lRRLR1CrqaewCCh-pnYGo8DxWfWdCx33dL02HsTzo58XgJR2SZ-N8cHusy0BdaCmimfrTusPZuqymigr_aVGfbVQsRzO-VzmyJF_DF9jBb-GsOzWY-_4V8YTq4Kh0cXngb1LNnngHMHc2EdgoNHP2_ip4w Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Project-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Project-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Tenant: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Tenant-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-User: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:06 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:42:06 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:42:06 user devstack@n-api.service[72696]: X-User-Id: b9da4c1fc6e54f7a8c780f9450b9f826 Apr 12 07:42:06 user devstack@n-api.service[72696]: X-User-Name: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:06 user devstack@n-api.service[72696]: method: > Apr 12 07:42:06 user devstack@n-api.service[72696]: exception: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72696]: action_args: {'server_id': '4f40c85d-313c-4485-8131-37d4c53441d7'} Apr 12 07:42:06 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:06 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Returning 404 to user: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-a08e5d28-d1e8-4472-a475-d330c8c49f11 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042259 Apr 12 07:42:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:06 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:06 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lazy-loading 'services' on Instance uuid 62827796-517b-46bd-acb2-98247fa081f4 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:42:06 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-62f55163-0b49-4bfa-a52e-acf29c9ff0a0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments/a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6" status: 202 len: 0 microversion: 2.49 time: 0.175423 Apr 12 07:42:06 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 67/198] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 07:42:06 2023] DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments/a343ce4a-e4ba-4c30-9f04-20a2dc7b99a6 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2e664ecc-398d-42fb-85d5-3dbc7b84c7c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1656 microversion: 2.1 time: 0.173191 Apr 12 07:42:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:07 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-39fbd748-0599-4349-bb48-52da274c4dca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1656 microversion: 2.1 time: 0.290736 Apr 12 07:42:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:07 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1656 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-bf824bae-70c2-4e1a-be27-2bca8248dba1 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052820 Apr 12 07:42:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:07 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-720d4a35-e36c-434a-ba92-371556f0e34b tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047700 Apr 12 07:42:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:07 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:42:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c36ca140-b374-426b-a2a4-bc9dec1ecfd5 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 204 len: 0 microversion: 2.1 time: 0.131071 Apr 12 07:42:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:42:07 2023] DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1945c498db466dba6c16af19ff42d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7b4669bf684bdaa24332f6821c7186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4aad9f66-7c15-49be-bb1c-b940f0003fe6 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 200 len: 1671 microversion: 2.1 time: 0.184940 Apr 12 07:42:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:08 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:08 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "name": "network-vif-unplugged", "status": "completed", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] Creating event network-vif-unplugged:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:42:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f986d800-93d6-4352-8322-c5f9ddceb62d req-c4ad8cb2-27fb-46c9-86ba-b3bfe459d900 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029870 Apr 12 07:42:08 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 68/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] HTTP exception thrown: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Request method failure captured: Apr 12 07:42:08 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 HTTP/1.1 Apr 12 07:42:08 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:42:08 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:42:08 user devstack@n-api.service[72696]: Connection: close Apr 12 07:42:08 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:42:08 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:42:08 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:42:08 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:42:08 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAfskLuRrF4wqnHpbrL2lRRLR1CrqaewCCh-pnYGo8DxWfWdCx33dL02HsTzo58XgJR2SZ-N8cHusy0BdaCmimfrTusPZuqymigr_aVGfbVQsRzO-VzmyJF_DF9jBb-GsOzWY-_4V8YTq4Kh0cXngb1LNnngHMHc2EdgoNHP2_ip4w Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Project-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Project-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Tenant: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Tenant-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-User: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:08 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:42:08 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:42:08 user devstack@n-api.service[72696]: X-User-Id: b9da4c1fc6e54f7a8c780f9450b9f826 Apr 12 07:42:08 user devstack@n-api.service[72696]: X-User-Name: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:08 user devstack@n-api.service[72696]: method: > Apr 12 07:42:08 user devstack@n-api.service[72696]: exception: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72696]: action_args: {'id': '4f40c85d-313c-4485-8131-37d4c53441d7'} Apr 12 07:42:08 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Returning 404 to user: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d67bb15a-5c16-4f02-91b8-ed5d167475e8 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 404 len: 111 microversion: 2.1 time: 0.037627 Apr 12 07:42:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:42:08 2023] DELETE /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] [instance: 4f40c85d-313c-4485-8131-37d4c53441d7] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] HTTP exception thrown: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Request method failure captured: Apr 12 07:42:08 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 HTTP/1.1 Apr 12 07:42:08 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:42:08 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:42:08 user devstack@n-api.service[72695]: Connection: close Apr 12 07:42:08 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:42:08 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:42:08 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:42:08 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:42:08 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAfskLuRrF4wqnHpbrL2lRRLR1CrqaewCCh-pnYGo8DxWfWdCx33dL02HsTzo58XgJR2SZ-N8cHusy0BdaCmimfrTusPZuqymigr_aVGfbVQsRzO-VzmyJF_DF9jBb-GsOzWY-_4V8YTq4Kh0cXngb1LNnngHMHc2EdgoNHP2_ip4w Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Project-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Project-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a1237d4763c436fbbeaf03fad8ee570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Tenant: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Tenant-Id: 4a1237d4763c436fbbeaf03fad8ee570 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756098866 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-User: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:08 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:42:08 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:42:08 user devstack@n-api.service[72695]: X-User-Id: b9da4c1fc6e54f7a8c780f9450b9f826 Apr 12 07:42:08 user devstack@n-api.service[72695]: X-User-Name: tempest-DeleteServersTestJSON-1756098866-project-member Apr 12 07:42:08 user devstack@n-api.service[72695]: method: > Apr 12 07:42:08 user devstack@n-api.service[72695]: exception: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72695]: action_args: {'id': '4f40c85d-313c-4485-8131-37d4c53441d7'} Apr 12 07:42:08 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. Apr 12 07:42:08 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:42:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] Returning 404 to user: Instance 4f40c85d-313c-4485-8131-37d4c53441d7 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a046b22c-8df0-42ed-b8fb-55c037e4d582 tempest-DeleteServersTestJSON-1756098866 tempest-DeleteServersTestJSON-1756098866-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7" status: 404 len: 111 microversion: 2.1 time: 0.050062 Apr 12 07:42:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:08 2023] GET /compute/v2.1/servers/4f40c85d-313c-4485-8131-37d4c53441d7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d0538deb-b912-405d-8676-c9ee0fd596f9 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface/5029176a-9429-4679-a589-7443e73e2f0e" status: 202 len: 0 microversion: 2.49 time: 0.092056 Apr 12 07:42:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 69/208] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 07:42:09 2023] DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-interface/5029176a-9429-4679-a589-7443e73e2f0e => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2aaf0c08-21f3-458e-b29b-191e7eb02d0e tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9" status: 200 len: 474 microversion: 2.49 time: 0.235539 Apr 12 07:42:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 70/209] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 07:42:09 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9 => generated 474 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:42:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "name": "network-vif-deleted", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=28 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] Creating event network-vif-deleted:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:42:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-e5e683ec-5707-41a7-8a93-b5da86eb0166 req-11ab19ff-2e27-4c13-845e-8d65c365de48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040117 Apr 12 07:42:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 71/210] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:42:10 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76db9cd6-5ebe-4e71-bbda-5734ed2dbc53", "name": "network-vif-plugged", "status": "completed", "tag": "0685968d-8af1-412f-8755-27d88ae32314"}, {"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-unplugged", "status": "completed", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}, {"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:10 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:10 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:10 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Creating event network-vif-plugged:0685968d-8af1-412f-8755-27d88ae32314 for instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 on user Apr 12 07:42:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Creating event network-vif-unplugged:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:42:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] Creating event network-vif-plugged:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:42:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-4957ecb4-7a35-450c-8f57-aa7cab1b2179 req-e01526fe-236a-4e2e-96b5-20799e093ba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038442 Apr 12 07:42:10 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 70/211] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-deleted", "tag": "5029176a-9429-4679-a589-7443e73e2f0e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] Creating event network-vif-deleted:5029176a-9429-4679-a589-7443e73e2f0e for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:42:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-80d6f39e-997a-46ee-899d-14dc583ce1a1 req-9da6db3a-4dec-40e0-8ce8-8e23a90c2c42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028844 Apr 12 07:42:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 71/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fe614731-c9cd-41da-8500-baae06d6d070 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '.version_select at 0x7f7c05397520>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fe614731-c9cd-41da-8500-baae06d6d070 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170" status: 200 len: 1723 microversion: 2.1 time: 0.083653 Apr 12 07:42:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 07:42:13 2023] GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170 => generated 1723 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-54ed9cc4-addd-45cc-a2ae-f7a0e4b03d2d tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '.version_select at 0x7f7c0545bf40>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-54ed9cc4-addd-45cc-a2ae-f7a0e4b03d2d tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170" status: 200 len: 1723 microversion: 2.1 time: 0.071104 Apr 12 07:42:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 07:42:13 2023] GET /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170 => generated 1723 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:13 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d9d2e931-2bfd-405c-a9ed-09c4708b0df6 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1673 microversion: 2.1 time: 0.213520 Apr 12 07:42:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:13 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:13 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-38986afa-678b-4431-bb91-efbd2b82888b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 200 len: 1379 microversion: 2.1 time: 0.228571 Apr 12 07:42:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:13 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 1379 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b38087ab-db0e-43b1-b3ce-d53e64c3e09e tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059781 Apr 12 07:42:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:18 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-48a867dc-a0f7-43f7-89f1-f0b547297ee9 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059258 Apr 12 07:42:18 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:18 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lazy-loading 'services' on Instance uuid eee310e4-bed8-405f-bfc6-a6bc3085293d {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:42:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3efbf463-88f3-4467-82dc-35db441c4eaa tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/31c6f68c-7746-42ac-ad97-9c6e35dcc9af" status: 202 len: 0 microversion: 2.1 time: 0.197851 Apr 12 07:42:18 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 74/219] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:42:18 2023] DELETE /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments/31c6f68c-7746-42ac-ad97-9c6e35dcc9af => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-dc82a2d0-0055-40c4-b37d-c1d7dd77b169 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052198 Apr 12 07:42:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:18 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:20 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-10319c8e-2fcf-4d65-93e4-080cf1013ced tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1688 microversion: 2.1 time: 0.187100 Apr 12 07:42:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:20 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ba1f4d22-20d5-49e9-821f-13777ea20bce tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.199827 Apr 12 07:42:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 75/222] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 07:42:23 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730/os-interface => generated 1828 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=30 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] Creating event network-changed:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-92b402d0-3118-4753-a26b-4d9bd1005b4f req-0c9f8077-32b2-4d5a-9c00-8e9da4630a8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060730 Apr 12 07:42:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 74/223] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f027b943-6bef-400f-843a-46585ee8130f tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 200 len: 2822 microversion: 2.42 time: 0.345045 Apr 12 07:42:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 75/224] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:42:24 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 2822 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0719404d-8327-4383-bf29-0cd946dcec6e tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.269157 Apr 12 07:42:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 76/225] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 07:42:25 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730/os-interface => generated 1828 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:42:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f59d6fd9-30d7-4df3-97ac-312fb12194d4 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 204 len: 0 microversion: 2.42 time: 0.157668 Apr 12 07:42:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 75/226] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:42:26 2023] DELETE /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:27 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74586fa38f44010878c70a8e60395ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a14e30be0d8491a915bb08ed9d296ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-33de6e0e-feb8-489c-90c9-74a35e84dd26 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 200 len: 2947 microversion: 2.42 time: 0.330924 Apr 12 07:42:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 76/227] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:42:27 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 2947 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:42:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] Creating event network-vif-unplugged:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-533425c7-b171-49bf-ae96-276b381ee971 req-c4018838-368c-4a87-9ea5-345c37b4e490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034112 Apr 12 07:42:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] Creating event network-vif-unplugged:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-004f1f73-19ae-4071-9007-d58cd4c64145 req-1f9006f3-77f9-4aa1-b3eb-509408f0e991 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043617 Apr 12 07:42:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 76/229] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:28 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:28 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] Creating event network-vif-unplugged:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:28 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-59141ffe-d331-4b49-a265-3ca8dc09b4c0 req-a4e74b07-6448-4790-9543-508c64308b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048429 Apr 12 07:42:28 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "2817bde8-a488-48b9-a877-32abe9e58c2b"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "2817bde8-a488-48b9-a877-32abe9e58c2b"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "7522065e-41bf-4026-a63d-998d70579447"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "7522065e-41bf-4026-a63d-998d70579447"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Creating event network-vif-plugged:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Creating event network-vif-unplugged:2817bde8-a488-48b9-a877-32abe9e58c2b for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Creating event network-vif-plugged:2817bde8-a488-48b9-a877-32abe9e58c2b for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Creating event network-vif-unplugged:7522065e-41bf-4026-a63d-998d70579447 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] Creating event network-vif-plugged:7522065e-41bf-4026-a63d-998d70579447 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fac0fc01-e8b4-4b2c-90cf-a0f9ac40774d req-74b64ba4-23e7-4406-8397-0e5b74128bbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.037734 Apr 12 07:42:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-unplugged", "status": "completed", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Creating event network-vif-plugged:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Creating event network-vif-unplugged:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Creating event network-vif-plugged:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Creating event network-vif-unplugged:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] Creating event network-vif-plugged:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f1dfd96f-0e87-4d17-994d-951689ed406e req-f129b789-470f-4808-a9ff-f913dbd901d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.035852 Apr 12 07:42:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 77/232] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:29 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-plugged", "status": "completed", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] Creating event network-vif-plugged:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-e5dff542-db98-4f54-b8e6-049673b83fd2 req-eb0df0bb-494f-44dc-8418-d21b2dfdb047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037065 Apr 12 07:42:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-deleted", "tag": "9e64b3a6-89bf-4238-83c1-fb78e3554ce6"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] Creating event network-vif-deleted:9e64b3a6-89bf-4238-83c1-fb78e3554ce6 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-8814c2f6-105f-4efa-8502-533cd03ca092 req-f188c9e1-5172-44f9-a1d5-3e571ca76419 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100733 Apr 12 07:42:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-deleted", "tag": "75ebd090-5ce9-45a9-9eab-fd31dccfebb2"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-deleted", "tag": "d8c70afe-012b-434e-a992-d87aff92acfa"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-deleted", "tag": "b1942edc-4ba6-4b7f-b375-cfc4429e61e1"}, {"server_uuid": "23c2ab3f-ce38-434b-a879-91f43d16f730", "name": "network-vif-deleted", "tag": "686e8d90-a1be-43bf-86d2-72830eb7f3b9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Creating event network-vif-deleted:75ebd090-5ce9-45a9-9eab-fd31dccfebb2 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Creating event network-vif-deleted:d8c70afe-012b-434e-a992-d87aff92acfa for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Creating event network-vif-deleted:b1942edc-4ba6-4b7f-b375-cfc4429e61e1 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] Creating event network-vif-deleted:686e8d90-a1be-43bf-86d2-72830eb7f3b9 for instance 23c2ab3f-ce38-434b-a879-91f43d16f730 on user Apr 12 07:42:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-cac716c1-f6ad-48e4-af43-e205c1611915 req-49b8a111-0fd6-494a-a431-2696ba57a886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039891 Apr 12 07:42:34 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 78/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:34 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=9 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=21 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c09036b4-9952-4d86-814f-0a2f752230b1 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055358 Apr 12 07:42:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:42:51 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=15 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1788052455", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "794c3330-22fe-49a1-a6ed-46aac1833b26"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] validate_networks() for [('794c3330-22fe-49a1-a6ed-46aac1833b26', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Getting quotas for user 8de4929e67ed472b90e95066b2c50340 and project 19a93f4d88764fd49cd8b2eb9ff1cb8f. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:42:52 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:42:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4fd0ceed-d1de-466c-bcdc-a498a6bd070f tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.607625 Apr 12 07:42:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 80/237] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:42:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:42:52 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6de4b06c-823e-4e9c-bea2-07d71a9d924b tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:52 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6de4b06c-823e-4e9c-bea2-07d71a9d924b tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:52 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:52 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:42:52 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-6de4b06c-823e-4e9c-bea2-07d71a9d924b tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:42:52 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6de4b06c-823e-4e9c-bea2-07d71a9d924b tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7" status: 200 len: 1212 microversion: 2.1 time: 0.082217 Apr 12 07:42:52 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:52 2023] GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] Creating event network-changed:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:42:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-87330c91-b11f-4e7f-a7d8-cc9141b03db5 req-1ffbc160-fa42-4d67-ba3f-f20cbfe669a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032657 Apr 12 07:42:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "name": "network-vif-plugged", "status": "completed", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:42:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] Creating event network-vif-plugged:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:42:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7e67bc90-4247-46f3-ba5a-c2242fb3629f req-d307d9ad-b5af-4dd0-b006-de2c4505c9e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035263 Apr 12 07:42:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 81/240] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] HTTP exception thrown: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Request method failure captured: Apr 12 07:42:58 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 HTTP/1.1 Apr 12 07:42:58 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:42:58 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:42:58 user devstack@n-api.service[72697]: Connection: close Apr 12 07:42:58 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:42:58 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:42:58 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:42:58 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:42:58 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmArw7beuyj6PXIXVebNFhi7j9uEDQzXK66Pt3Ym312ItnvOmzq-L0XhseMO-4uab_xn8ZZK6-AU9gl0PJT5t850nPF2GxhoNgQZLhXvBgytt5e1inrLbKAdCFe6pKqzmuJ0u41jJZ672rOa66ozsqlAE27HO1tjlWtTCqrwHkiNSrk Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Project-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Tenant-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-User: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:42:58 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:42:58 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:42:58 user devstack@n-api.service[72697]: X-User-Id: 4a1945c498db466dba6c16af19ff42d0 Apr 12 07:42:58 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:42:58 user devstack@n-api.service[72697]: method: > Apr 12 07:42:58 user devstack@n-api.service[72697]: exception: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:42:58 user devstack@n-api.service[72697]: action_args: {'id': '76db9cd6-5ebe-4e71-bbda-5734ed2dbc53'} Apr 12 07:42:58 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:42:58 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:42:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Returning 404 to user: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:42:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-19a858af-894b-4d6b-8e65-b05ad34146ea tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 404 len: 111 microversion: 2.1 time: 0.033428 Apr 12 07:42:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 80/241] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:42:58 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:42:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-532d8619-61cc-4c21-abfc-293e5fe95d71 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '.version_select at 0x7f7c052b0ca0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-532d8619-61cc-4c21-abfc-293e5fe95d71 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375571147" status: 202 len: 0 microversion: 2.1 time: 0.030771 Apr 12 07:42:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 07:42:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375571147 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-853c294e-188b-4ff1-b960-8293b547c3bb tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9" status: 200 len: 503 microversion: 2.49 time: 0.100285 Apr 12 07:42:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 82/243] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 07:42:59 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9 => generated 503 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d6d6b4bf-0c56-40aa-95dc-f2ec54f090fc tempest-TaggedAttachmentsTest-24144678 tempest-TaggedAttachmentsTest-24144678-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9" status: 200 len: 503 microversion: 2.49 time: 0.089720 Apr 12 07:42:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 81/244] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 07:42:59 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-instance-actions/req-d0538deb-b912-405d-8676-c9ee0fd596f9 => generated 503 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-00d263ea-726a-425b-9eb5-45ec26c9c1b0 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.066955 Apr 12 07:42:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 07:42:59 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:42:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:42:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-43c12b1e-9809-4cab-882d-10c03b5b35c2 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 204 len: 0 microversion: 2.49 time: 0.133113 Apr 12 07:42:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 83/246] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:42:59 2023] DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "name": "network-vif-plugged", "status": "completed", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] Creating event network-vif-plugged:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:43:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-2e6f814f-bbd4-4b60-bcf2-804a404c0e05 req-2da01305-c8f4-4533-b9af-f55acfa664a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043772 Apr 12 07:43:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:00 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0082023d624048c796622b4142d89ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a790f72405ee4b4ca977ba829dbd8971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2b7974a2-7816-486b-8d67-6fd94d9c7cee tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 200 len: 1750 microversion: 2.49 time: 0.237472 Apr 12 07:43:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 82/248] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:00 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] HTTP exception thrown: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Request method failure captured: Apr 12 07:43:01 user devstack@n-api.service[72695]: request: DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 HTTP/1.1 Apr 12 07:43:01 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:43:01 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:43:01 user devstack@n-api.service[72695]: Connection: close Apr 12 07:43:01 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:43:01 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:43:01 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:43:01 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:43:01 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmArw7beuyj6PXIXVebNFhi7j9uEDQzXK66Pt3Ym312ItnvOmzq-L0XhseMO-4uab_xn8ZZK6-AU9gl0PJT5t850nPF2GxhoNgQZLhXvBgytt5e1inrLbKAdCFe6pKqzmuJ0u41jJZ672rOa66ozsqlAE27HO1tjlWtTCqrwHkiNSrk Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Project-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Tenant-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-User: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:43:01 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:43:01 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:43:01 user devstack@n-api.service[72695]: X-User-Id: 4a1945c498db466dba6c16af19ff42d0 Apr 12 07:43:01 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:43:01 user devstack@n-api.service[72695]: method: > Apr 12 07:43:01 user devstack@n-api.service[72695]: exception: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72695]: action_args: {'id': '76db9cd6-5ebe-4e71-bbda-5734ed2dbc53'} Apr 12 07:43:01 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Returning 404 to user: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d511f909-7919-4eb2-a4ce-a9a4e251948c tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 404 len: 111 microversion: 2.1 time: 0.037511 Apr 12 07:43:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:43:01 2023] DELETE /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] [instance: 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] HTTP exception thrown: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Request method failure captured: Apr 12 07:43:01 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 HTTP/1.1 Apr 12 07:43:01 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:01 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:01 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:01 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:01 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:01 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:01 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:01 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmArw7beuyj6PXIXVebNFhi7j9uEDQzXK66Pt3Ym312ItnvOmzq-L0XhseMO-4uab_xn8ZZK6-AU9gl0PJT5t850nPF2GxhoNgQZLhXvBgytt5e1inrLbKAdCFe6pKqzmuJ0u41jJZ672rOa66ozsqlAE27HO1tjlWtTCqrwHkiNSrk Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Project-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7b4669bf684bdaa24332f6821c7186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Tenant-Id: 9a7b4669bf684bdaa24332f6821c7186 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-20787824 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-User: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:43:01 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:01 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:01 user devstack@n-api.service[72696]: X-User-Id: 4a1945c498db466dba6c16af19ff42d0 Apr 12 07:43:01 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-20787824-project-member Apr 12 07:43:01 user devstack@n-api.service[72696]: method: > Apr 12 07:43:01 user devstack@n-api.service[72696]: exception: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72696]: action_args: {'id': '76db9cd6-5ebe-4e71-bbda-5734ed2dbc53'} Apr 12 07:43:01 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. Apr 12 07:43:01 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] Returning 404 to user: Instance 76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-bcbc4add-2110-47a8-ac3c-36da05cc6fc0 tempest-AttachSCSIVolumeTestJSON-20787824 tempest-AttachSCSIVolumeTestJSON-20787824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53" status: 404 len: 111 microversion: 2.1 time: 0.049774 Apr 12 07:43:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:01 2023] GET /compute/v2.1/servers/76db9cd6-5ebe-4e71-bbda-5734ed2dbc53 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-deleted", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] Creating event network-vif-deleted:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:43:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-4bc17453-beaa-4c72-a736-c59a4524474e req-7b643b0c-c1e0-4142-93c5-6e9da4bfdbd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041085 Apr 12 07:43:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-unplugged", "status": "completed", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}, {"server_uuid": "62827796-517b-46bd-acb2-98247fa081f4", "name": "network-vif-plugged", "status": "completed", "tag": "49ee8142-11f3-45a6-8a4d-be1968aa1ca1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Creating event network-vif-unplugged:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:43:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] Creating event network-vif-plugged:49ee8142-11f3-45a6-8a4d-be1968aa1ca1 for instance 62827796-517b-46bd-acb2-98247fa081f4 on user Apr 12 07:43:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-c53dde47-78bc-4970-a659-6c500fcec59d req-dea45916-b361-44df-87f2-71d8f81410db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034860 Apr 12 07:43:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:43:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e08b2bad-3e89-4330-b266-f73c3130d6e7 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 204 len: 0 microversion: 2.1 time: 0.286861 Apr 12 07:43:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:43:02 2023] DELETE /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:03 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e239e4fc-725d-4cee-b84d-49c0f13594e8 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 200 len: 1498 microversion: 2.1 time: 0.244841 Apr 12 07:43:03 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:02 2023] GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "name": "network-vif-unplugged", "status": "completed", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}, {"server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "name": "network-vif-plugged", "status": "completed", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Creating event network-vif-unplugged:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:43:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] Creating event network-vif-plugged:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:43:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-e21dd4b8-2460-4099-8bde-e9d3b98fbc3c req-bc4d7e7e-8be1-4f99-98d3-4b86060538d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051610 Apr 12 07:43:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71c5ba4-aeff-454c-a89c-0cef7ab13806", "name": "network-vif-deleted", "tag": "0cb5bbd3-349d-4eac-834b-1bb7aeed5cee"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] Creating event network-vif-deleted:0cb5bbd3-349d-4eac-834b-1bb7aeed5cee for instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 on user Apr 12 07:43:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-168c1a27-7835-4139-a03d-63162d0ecb91 req-afa296b0-ef7d-4152-8e51-bea12864b2bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044122 Apr 12 07:43:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 85/256] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:06 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-1bff484b-0ab5-4dcb-a6eb-52a615c1bca3 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1502 microversion: 2.1 time: 0.540174 Apr 12 07:43:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:06 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1502 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-55e86ee1-4a5c-496b-8041-53d457267d11 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043195 Apr 12 07:43:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:43:08 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:43:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b0ea50ac-0c79-4771-9730-1c4362a9e26c tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d" status: 204 len: 0 microversion: 2.1 time: 0.128000 Apr 12 07:43:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:43:09 2023] DELETE /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-07d530a5-136e-43af-b312-1cd8956846a0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1656 microversion: 2.1 time: 0.254270 Apr 12 07:43:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:09 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1656 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63f5525-138b-4fd7-8ec1-59c92063ee9e"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9750ae336a14eb3b0bcc849aa67a026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5fc0e264e047c1b874854907be678e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-05dc9177-3c2a-4a5c-9de4-871068d000b5 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d" status: 200 len: 1650 microversion: 2.1 time: 0.275023 Apr 12 07:43:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:09 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d => generated 1650 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "name": "network-vif-unplugged", "status": "completed", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] Creating event network-vif-unplugged:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:43:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-eb0f69c8-dd5b-4cf2-86b1-de600219dfb9 req-f00dc056-c9d5-4bf0-a10e-bed015639bf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032853 Apr 12 07:43:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 87/262] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-79a522be-cc52-437b-a5f3-bb27d20eb994 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426134 Apr 12 07:43:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:43:09 2023] POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "name": "network-vif-plugged", "status": "completed", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}, {"server_uuid": "eee310e4-bed8-405f-bfc6-a6bc3085293d", "name": "network-vif-deleted", "tag": "e0de1b4f-faa3-4c31-8cdd-25dff971246c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Creating event network-vif-plugged:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:43:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] Creating event network-vif-deleted:e0de1b4f-faa3-4c31-8cdd-25dff971246c for instance eee310e4-bed8-405f-bfc6-a6bc3085293d on user Apr 12 07:43:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-0d6ba5c0-6ba7-4889-9a7c-e0ee96c35c28 req-d05f640a-f886-4f3d-87e1-3f51bdf7182c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029423 Apr 12 07:43:11 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-634be4ff-4764-4f6a-ad18-479314b47ee9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 200 len: 1379 microversion: 2.1 time: 0.401809 Apr 12 07:43:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:13 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 1379 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-52396c25-dba7-4ab9-a49e-1e12a6af00f1 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1673 microversion: 2.1 time: 0.240205 Apr 12 07:43:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 89/266] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:14 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:14 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0feb0109-86da-45ab-bd1e-d65254b1674a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 200 len: 1379 microversion: 2.1 time: 0.176608 Apr 12 07:43:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 90/267] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:14 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 1379 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:43:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8c9b7261-08fb-499f-b9ae-e1b3ccaea6fe tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 204 len: 0 microversion: 2.1 time: 0.135318 Apr 12 07:43:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 89/268] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:43:14 2023] DELETE /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:15 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ef6fef8c-6839-4522-baca-6746d0638578 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 200 len: 1385 microversion: 2.1 time: 0.244300 Apr 12 07:43:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:14 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 1385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "name": "network-vif-unplugged", "status": "completed", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] Creating event network-vif-unplugged:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:43:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-790e34ca-bb05-4025-a781-d07146012ebd req-01950911-f696-49a5-8ce6-5b992ef8e711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032856 Apr 12 07:43:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50ebd7de-6dee-4a5b-ba64-d910fb73e897"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f8b8ff3c-f89d-4c4c-8b79-dbe469a6b0ca tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351680 Apr 12 07:43:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 90/271] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:43:15 2023] POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "name": "network-vif-plugged", "status": "completed", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] Creating event network-vif-plugged:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:43:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d14d979b-bd87-45e0-ad93-656b7a554f53 req-acb33f72-688f-42e8-9ca6-a9275f5246f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Apr 12 07:43:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cb3965-b028-474d-90b3-b8c6f33b62a2", "name": "network-vif-deleted", "tag": "9e37061f-71da-4cdf-b22b-814cda161f85"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] Creating event network-vif-deleted:9e37061f-71da-4cdf-b22b-814cda161f85 for instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 on user Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-930b4a28-9ca1-4ef7-8cc8-127da926e8be req-0c45bfa6-6d35-4c73-907b-a435732538de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045871 Apr 12 07:43:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HTTP exception thrown: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Request method failure captured: Apr 12 07:43:17 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 HTTP/1.1 Apr 12 07:43:17 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:17 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:17 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:17 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:17 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:17 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:17 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:17 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAviLrbE_CuAl0d71G5beo9vMxJ1FDHHjiO9uR39IutQW9GNm2Hg6o5Igrwn3rxMzS03h64RhbfvXA2xwHHwhSbHGtChQ6GdqiUnoE2K0gsElwjAhZdbXNp97FlDdwnGikFF2Ay44q8SDgSzWzgE3vjJ6ndMvWEmijcGmMcWDRwURI Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Project-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Tenant-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:17 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:17 user devstack@n-api.service[72696]: X-User: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:17 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:17 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:17 user devstack@n-api.service[72696]: X-User-Id: b74586fa38f44010878c70a8e60395ae Apr 12 07:43:17 user devstack@n-api.service[72696]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:17 user devstack@n-api.service[72696]: method: > Apr 12 07:43:17 user devstack@n-api.service[72696]: exception: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:17 user devstack@n-api.service[72696]: action_args: {'id': '23c2ab3f-ce38-434b-a879-91f43d16f730'} Apr 12 07:43:17 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Returning 404 to user: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7ce23c2f-7eca-4009-aa27-4375b2a72e27 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 404 len: 111 microversion: 2.42 time: 0.034936 Apr 12 07:43:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:17 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3460ed99-67e4-4a7c-b7c5-90e37cd8063d tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '.version_select at 0x7f7c053e1480>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3460ed99-67e4-4a7c-b7c5-90e37cd8063d tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413750630" status: 204 len: 0 microversion: 2.42 time: 0.032212 Apr 12 07:43:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 93/275] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 07:43:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413750630 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4eb4eb3f-4be6-42bf-85ac-a92a4b2e1ba9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1702 microversion: 2.1 time: 0.170285 Apr 12 07:43:17 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 91/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:17 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1702 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-926530387", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: dict_keys(['metadata_items']) {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: dict_keys(['metadata_items']) {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:43:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d4290009-f32f-4606-8da6-fb49dfc85b0c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action" status: 202 len: 1158 microversion: 2.1 time: 0.452366 Apr 12 07:43:18 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 93/277] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 07:43:17 2023] POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action => generated 1158 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:18 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d051864f-fd42-44f4-9721-00da4c0f0128 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1729 microversion: 2.1 time: 0.236456 Apr 12 07:43:18 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:18 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:19 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-unplugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] Creating event network-vif-unplugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:43:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-efd60d03-0670-42a1-b6b8-3f311e42d2c8 req-eca727d5-18be-4ca8-afda-9f0a65b8684c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067215 Apr 12 07:43:19 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 92/279] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:20 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Going to try to start instance {{(pid=72696) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 07:43:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f95b5ae4-e8ac-4f7f-b2e4-dcf64ff853a5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.079256 Apr 12 07:43:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:43:20 2023] POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-230cae30-60b2-4938-9ecf-ab6b0c1c3a80 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1697 microversion: 2.1 time: 0.276623 Apr 12 07:43:21 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:20 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1697 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HTTP exception thrown: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Request method failure captured: Apr 12 07:43:21 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 HTTP/1.1 Apr 12 07:43:21 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:43:21 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:43:21 user devstack@n-api.service[72697]: Connection: close Apr 12 07:43:21 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:43:21 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:43:21 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:43:21 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:43:21 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAviLrbE_CuAl0d71G5beo9vMxJ1FDHHjiO9uR39IutQW9GNm2Hg6o5Igrwn3rxMzS03h64RhbfvXA2xwHHwhSbHGtChQ6GdqiUnoE2K0gsElwjAhZdbXNp97FlDdwnGikFF2Ay44q8SDgSzWzgE3vjJ6ndMvWEmijcGmMcWDRwURI Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Project-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Tenant-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:21 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72697]: X-User: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:21 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:43:21 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:43:21 user devstack@n-api.service[72697]: X-User-Id: b74586fa38f44010878c70a8e60395ae Apr 12 07:43:21 user devstack@n-api.service[72697]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:21 user devstack@n-api.service[72697]: method: > Apr 12 07:43:21 user devstack@n-api.service[72697]: exception: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72697]: action_args: {'id': '23c2ab3f-ce38-434b-a879-91f43d16f730'} Apr 12 07:43:21 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Returning 404 to user: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-21902978-1aae-41f1-b0eb-946c182f1027 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 404 len: 111 microversion: 2.42 time: 0.033156 Apr 12 07:43:21 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 93/282] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:43:21 2023] DELETE /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] [instance: 23c2ab3f-ce38-434b-a879-91f43d16f730] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] HTTP exception thrown: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Request method failure captured: Apr 12 07:43:21 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 HTTP/1.1 Apr 12 07:43:21 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:21 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:21 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:21 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:21 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:21 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:21 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:21 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAviLrbE_CuAl0d71G5beo9vMxJ1FDHHjiO9uR39IutQW9GNm2Hg6o5Igrwn3rxMzS03h64RhbfvXA2xwHHwhSbHGtChQ6GdqiUnoE2K0gsElwjAhZdbXNp97FlDdwnGikFF2Ay44q8SDgSzWzgE3vjJ6ndMvWEmijcGmMcWDRwURI Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Project-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a14e30be0d8491a915bb08ed9d296ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Tenant-Id: 7a14e30be0d8491a915bb08ed9d296ce Apr 12 07:43:21 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1306806466 Apr 12 07:43:21 user devstack@n-api.service[72696]: X-User: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:21 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:21 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:21 user devstack@n-api.service[72696]: X-User-Id: b74586fa38f44010878c70a8e60395ae Apr 12 07:43:21 user devstack@n-api.service[72696]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1306806466-project-member Apr 12 07:43:21 user devstack@n-api.service[72696]: method: > Apr 12 07:43:21 user devstack@n-api.service[72696]: exception: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72696]: action_args: {'id': '23c2ab3f-ce38-434b-a879-91f43d16f730'} Apr 12 07:43:21 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. Apr 12 07:43:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] Returning 404 to user: Instance 23c2ab3f-ce38-434b-a879-91f43d16f730 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-6ce8c888-95e0-4d59-83d2-a756a0c370e9 tempest-TaggedBootDevicesTest_v242-1306806466 tempest-TaggedBootDevicesTest_v242-1306806466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730" status: 404 len: 111 microversion: 2.42 time: 0.046014 Apr 12 07:43:21 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 95/283] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:21 2023] GET /compute/v2.1/servers/23c2ab3f-ce38-434b-a879-91f43d16f730 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:43:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-acce2a14-7028-4fbc-a174-b965c85b2787 req-c9f80678-4d9b-4787-ba46-2befe5a3b961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037459 Apr 12 07:43:21 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "605c6427-e907-43e2-b4e9-f596062d8170"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:24 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'flavor' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:43:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8f7ce57b-3811-4833-8a80-de8eacaa33a4 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action" status: 200 len: 29 microversion: 2.1 time: 0.317396 Apr 12 07:43:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 94/285] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:43:24 2023] POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action => generated 29 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5b2e311b-bbfe-423c-b690-787d37e33feb tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1725 microversion: 2.1 time: 0.695642 Apr 12 07:43:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 96/286] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:24 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1725 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-unplugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:25 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] Creating event network-vif-unplugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:43:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-80576bc8-3bc6-4833-9daa-80935b133a01 req-e1e9af28-7c64-4774-b180-fd8a406840b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052819 Apr 12 07:43:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:43:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-bdc7e394-535d-4970-bb25-af5bfa23dde4 req-26bdd117-2deb-4597-a56a-0d0dc4dcebde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 Apr 12 07:43:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 95/288] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:29 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:43:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-b05adbf8-8341-4524-bb0e-a4971baace99 req-171762d8-215e-4d5b-a964-8f2fa8bd5a66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040341 Apr 12 07:43:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 97/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:43:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-21b7e283-e7c6-4e7b-a896-7284a40bfb08 req-e8d39fb2-7f95-485e-bc96-bf807c45cea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086430 Apr 12 07:43:31 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:31 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:43:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6eb0f043-8c62-457d-985e-59428b7d75ea req-7c99719f-32ee-45cb-ad6d-c260b03c5acc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Apr 12 07:43:31 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 96/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:33 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:33 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:43:33 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-66e92f41-cba5-456a-895e-8bfed05be890 req-6f6bd835-3ea9-4ef9-bff7-c1ed2b8dc610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039993 Apr 12 07:43:33 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:33 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}, {"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:43:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:43:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-d7849431-6ca1-4c68-8897-710c1bbc4f18 req-7900d250-1fbd-4deb-b5a4-c2762d174f29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051923 Apr 12 07:43:33 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-993d7234-a23b-40a4-a327-83f6e95ab721 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Action: 'create', calling method: .version_select at 0x7f7c0520ab00>, body: {"keypair": {"name": "tempest-keypair-765614204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJUA34sV4ih8LpLuR+3E3hbuwvJLzK6HUGAczbNllnlBV1IBf/6MuIwh4J5P2p179So4lnXf6fsxXXeowIHwxGWPkI+rVSKj8lF/6TPsbalalekjlIzo10Vr1wlOG4XmA=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:39 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-993d7234-a23b-40a4-a327-83f6e95ab721 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting quotas for project 57b9766adb34464a8991764937c0f755. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:43:39 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-993d7234-a23b-40a4-a327-83f6e95ab721 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting quotas for user e6ae1f3ccb2845fb9479448b50a0b919 and project 57b9766adb34464a8991764937c0f755. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:43:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-993d7234-a23b-40a4-a327-83f6e95ab721 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.090321 Apr 12 07:43:39 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 97/294] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 07:43:39 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 12 07:43:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0d1a4741-ea24-4b9e-9258-422f0014de7b tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c05120550>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0d1a4741-ea24-4b9e-9258-422f0014de7b tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/eaca3bfc-3a08-4edf-a2d0-58a8b38ef295" status: 200 len: 351 microversion: 2.1 time: 0.075490 Apr 12 07:43:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:43:41 2023] GET /compute/v2.1/os-volumes/eaca3bfc-3a08-4edf-a2d0-58a8b38ef295 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-440809034", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d8752b4e-67f0-47ea-8534-b709ccb1dbfb"}, {"port": "7d15bdba-2895-4995-93c4-a687e1b18ae7", "tag": "port-1"}, {"port": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff", "tag": "port-2"}, {"uuid": "d095779d-7e48-4417-bcc7-2da4d70b267b", "tag": "net-1"}, {"uuid": "d095779d-7e48-4417-bcc7-2da4d70b267b"}, {"uuid": "f521d7e5-4303-4398-b38a-6827dedbe33a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f521d7e5-4303-4398-b38a-6827dedbe33a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a2053ea8-adbe-41b6-9586-66df339c74fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "713f4c6b-831b-4ecd-b993-2071b2c76652", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "739007bc-1202-495e-a5a1-67750ec8ad7e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--868665756"}], "key_name": "tempest-keypair-765614204", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:41 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] validate_networks() for [('d8752b4e-67f0-47ea-8534-b709ccb1dbfb', None, None, None, None, None), (None, None, '7d15bdba-2895-4995-93c4-a687e1b18ae7', None, None, None), (None, None, 'b07e4269-65c3-4fc9-9eaf-bb063b07f3ff', None, None, None), ('d095779d-7e48-4417-bcc7-2da4d70b267b', None, None, None, None, None), ('d095779d-7e48-4417-bcc7-2da4d70b267b', None, None, None, None, None), ('f521d7e5-4303-4398-b38a-6827dedbe33a', '10.2.2.100', None, None, None, None), ('f521d7e5-4303-4398-b38a-6827dedbe33a', '10.2.2.200', None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:43:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-40c170ab-54dd-4103-b693-eb2b98cda3b0 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c0520b9a0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-40c170ab-54dd-4103-b693-eb2b98cda3b0 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b1cfe166-197c-44bd-8dcf-018a59bb368c" status: 200 len: 351 microversion: 2.1 time: 0.064446 Apr 12 07:43:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 98/296] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:43:42 2023] GET /compute/v2.1/os-volumes/b1cfe166-197c-44bd-8dcf-018a59bb368c => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:43 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0fc72aa1-4960-480a-8149-3e1801a379df tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7" status: 200 len: 1496 microversion: 2.1 time: 0.175743 Apr 12 07:43:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:42 2023] GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 => generated 1496 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=5 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting quotas for project 57b9766adb34464a8991764937c0f755. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:43:43 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Getting quotas for user e6ae1f3ccb2845fb9479448b50a0b919 and project 57b9766adb34464a8991764937c0f755. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:43:44 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:43:44 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a2053ea8-adbe-41b6-9586-66df339c74fe',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='713f4c6b-831b-4ecd-b993-2071b2c76652',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='739007bc-1202-495e-a5a1-67750ec8ad7e',volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-678da8fd-3a25-487b-b8de-ad4104938834 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c0520bf40>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-678da8fd-3a25-487b-b8de-ad4104938834 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/022a8739-d6f6-45e0-b527-b493a83552a7" status: 200 len: 350 microversion: 2.1 time: 0.054412 Apr 12 07:43:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes/022a8739-d6f6-45e0-b527-b493a83552a7 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-322cb824-921e-4f34-8b7a-e9edf19627b6 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c052b2710>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-322cb824-921e-4f34-8b7a-e9edf19627b6 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086389 Apr 12 07:43:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-77c3030c-62d9-4f92-a609-9874334f1c7c tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c0520a950>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-77c3030c-62d9-4f92-a609-9874334f1c7c tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.108266 Apr 12 07:43:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-322d0f13-2463-41c9-8629-ec9e2a420cc6 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.807500 Apr 12 07:43:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 100/301] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 07:43:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b808a933-8cc0-4cde-9c6b-268bcb461fcc tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c05123130>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-56453a28-2aab-49a9-8318-11d47b71b00e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 200 len: 1278 microversion: 2.32 time: 0.068053 Apr 12 07:43:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 101/302] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 1278 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b808a933-8cc0-4cde-9c6b-268bcb461fcc tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094775 Apr 12 07:43:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f1369989-d34a-46ad-a05b-dd6c06c80e36 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c053965f0>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f1369989-d34a-46ad-a05b-dd6c06c80e36 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106422 Apr 12 07:43:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-863dc35e-16b0-4635-b459-8f8f0ba4702e tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c0545ad40>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-863dc35e-16b0-4635-b459-8f8f0ba4702e tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096182 Apr 12 07:43:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b1dbda3a-121b-43bb-b7d6-1b182d14e301 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c05122ef0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b1dbda3a-121b-43bb-b7d6-1b182d14e301 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083950 Apr 12 07:43:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b6c51ee0-1116-4b2f-88bc-3a563c428c59 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c05294700>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b6c51ee0-1116-4b2f-88bc-3a563c428c59 tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100596 Apr 12 07:43:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 102/307] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bfc9da4a-10e8-4037-8fcb-bbdf6f9069ac tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] Calling method '.version_select at 0x7f7c0545acb0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-bfc9da4a-10e8-4037-8fcb-bbdf6f9069ac tempest-VolumesTestJSON-26589314 tempest-VolumesTestJSON-26589314-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.096896 Apr 12 07:43:45 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 07:43:44 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] HTTP exception thrown: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Request method failure captured: Apr 12 07:43:50 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 HTTP/1.1 Apr 12 07:43:50 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:50 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:50 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:50 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:50 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:50 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:50 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:50 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAsPAxwrQqN533PMzOCXIEmAH1RnCF3G3ZXfd6GT3O3nYkhgZIAjtmdS1DmwmcUWA_-wLuhJNPN2pWCwk4mBN-EziTuexiVHT-gZ-iMfIHYkb3L46jmnKf199FRYlBxK12z6x_aBZ453hRDAywxvUFecex8DLSCfDYKdBQhKf5StQk Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Project-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Project-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Tenant: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Tenant-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-User: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:50 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:50 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:50 user devstack@n-api.service[72696]: X-User-Id: 0082023d624048c796622b4142d89ab6 Apr 12 07:43:50 user devstack@n-api.service[72696]: X-User-Name: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:50 user devstack@n-api.service[72696]: method: > Apr 12 07:43:50 user devstack@n-api.service[72696]: exception: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:50 user devstack@n-api.service[72696]: action_args: {'id': '62827796-517b-46bd-acb2-98247fa081f4'} Apr 12 07:43:50 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:50 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Returning 404 to user: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e4fade6d-3607-4cdb-96e1-3808bf0481da tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 404 len: 111 microversion: 2.49 time: 0.048868 Apr 12 07:43:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:50 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:50 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-45f3d15b-a6f0-476d-b94b-2c1c5c465271 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '.version_select at 0x7f7c053e3490>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:50 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-45f3d15b-a6f0-476d-b94b-2c1c5c465271 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544690587" status: 204 len: 0 microversion: 2.49 time: 0.028043 Apr 12 07:43:50 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 103/310] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 07:43:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544690587 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:43:52 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:52 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] Creating event network-changed:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:43:52 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ade9a978-6fab-44f8-80ca-8f5ea06fb4c4 req-8c33aa2e-4a18-4253-bb51-284017d707e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035085 Apr 12 07:43:52 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 104/311] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] HTTP exception thrown: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:43:53 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 HTTP/1.1 Apr 12 07:43:53 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:53 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:53 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:53 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:53 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:53 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:53 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:53 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:43:53 user devstack@n-api.service[72696]: method: > Apr 12 07:43:53 user devstack@n-api.service[72696]: exception: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: action_args: {'id': 'b71c5ba4-aeff-454c-a89c-0cef7ab13806'} Apr 12 07:43:53 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 404 to user: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ed9c6566-2b2e-49ac-b6ae-1ee661f476ed tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 404 len: 111 microversion: 2.1 time: 0.043251 Apr 12 07:43:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:53 2023] GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] HTTP exception thrown: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Request method failure captured: Apr 12 07:43:53 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 HTTP/1.1 Apr 12 07:43:53 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:43:53 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:43:53 user devstack@n-api.service[72697]: Connection: close Apr 12 07:43:53 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:43:53 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:43:53 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:43:53 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:43:53 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAsPAxwrQqN533PMzOCXIEmAH1RnCF3G3ZXfd6GT3O3nYkhgZIAjtmdS1DmwmcUWA_-wLuhJNPN2pWCwk4mBN-EziTuexiVHT-gZ-iMfIHYkb3L46jmnKf199FRYlBxK12z6x_aBZ453hRDAywxvUFecex8DLSCfDYKdBQhKf5StQk Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Project-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Project-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Tenant: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Tenant-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-User: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:53 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72697]: X-User-Id: 0082023d624048c796622b4142d89ab6 Apr 12 07:43:53 user devstack@n-api.service[72697]: X-User-Name: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:53 user devstack@n-api.service[72697]: method: > Apr 12 07:43:53 user devstack@n-api.service[72697]: exception: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72697]: action_args: {'id': '62827796-517b-46bd-acb2-98247fa081f4'} Apr 12 07:43:53 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Returning 404 to user: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-08f6c6dd-69dd-4b0b-85c1-e77625c37036 tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 404 len: 111 microversion: 2.49 time: 0.044386 Apr 12 07:43:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 105/313] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:43:53 2023] DELETE /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] [instance: 62827796-517b-46bd-acb2-98247fa081f4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] HTTP exception thrown: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Request method failure captured: Apr 12 07:43:53 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 HTTP/1.1 Apr 12 07:43:53 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:53 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:53 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:53 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:53 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:53 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:53 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:53 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAsPAxwrQqN533PMzOCXIEmAH1RnCF3G3ZXfd6GT3O3nYkhgZIAjtmdS1DmwmcUWA_-wLuhJNPN2pWCwk4mBN-EziTuexiVHT-gZ-iMfIHYkb3L46jmnKf199FRYlBxK12z6x_aBZ453hRDAywxvUFecex8DLSCfDYKdBQhKf5StQk Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Project-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a790f72405ee4b4ca977ba829dbd8971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant-Id: a790f72405ee4b4ca977ba829dbd8971 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1393321118 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Id: 0082023d624048c796622b4142d89ab6 Apr 12 07:43:53 user devstack@n-api.service[72696]: X-User-Name: tempest-TaggedAttachmentsTest-1393321118-project-member Apr 12 07:43:53 user devstack@n-api.service[72696]: method: > Apr 12 07:43:53 user devstack@n-api.service[72696]: exception: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: action_args: {'id': '62827796-517b-46bd-acb2-98247fa081f4'} Apr 12 07:43:53 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. Apr 12 07:43:53 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] Returning 404 to user: Instance 62827796-517b-46bd-acb2-98247fa081f4 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-02a8949a-d994-4391-8a47-2ec2e8b98f2c tempest-TaggedAttachmentsTest-1393321118 tempest-TaggedAttachmentsTest-1393321118-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4" status: 404 len: 111 microversion: 2.49 time: 0.047221 Apr 12 07:43:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 106/314] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:43:53 2023] GET /compute/v2.1/servers/62827796-517b-46bd-acb2-98247fa081f4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:53 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:43:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6ed474d5-6126-4783-9fc8-5bbe8a46b6b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1492 microversion: 2.1 time: 0.359485 Apr 12 07:43:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:53 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1492 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:43:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "7d15bdba-2895-4995-93c4-a687e1b18ae7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:54 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] Creating event network-changed:7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:43:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-79fc648f-22b0-4176-86ab-f4276cddc9cb req-be501256-19f4-438a-aceb-197b6b055086 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041165 Apr 12 07:43:54 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 106/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-269e2c74-a4df-4c73-81ed-0c2db8197a2e tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Action: 'create', calling method: .version_select at 0x7f7c05123490>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1171525405", "metadata": {"Type": "work"}}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-269e2c74-a4df-4c73-81ed-0c2db8197a2e tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Length: 122 Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: Apr 12 07:43:55 user devstack@n-api.service[72696]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1171525405", "metadata": {"Type": "work"}}} Apr 12 07:43:55 user devstack@n-api.service[72696]: method: Apr 12 07:43:55 user devstack@n-api.service[72696]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72696]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1171525405', 'metadata': {'Type': 'work'}}}} Apr 12 07:43:55 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise error Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-269e2c74-a4df-4c73-81ed-0c2db8197a2e tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-269e2c74-a4df-4c73-81ed-0c2db8197a2e tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.317180 Apr 12 07:43:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 07:43:54 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-df5bb5fe-d9e3-4ec1-b758-b07e1b8fa839 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Action: 'create', calling method: .version_select at 0x7f7c053e3490>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1614273784", "metadata": {"Type": "work"}}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-df5bb5fe-d9e3-4ec1-b758-b07e1b8fa839 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72695]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72695]: Content-Length: 120 Apr 12 07:43:55 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72695]: Apr 12 07:43:55 user devstack@n-api.service[72695]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1614273784", "metadata": {"Type": "work"}}} Apr 12 07:43:55 user devstack@n-api.service[72695]: method: Apr 12 07:43:55 user devstack@n-api.service[72695]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 07:43:55 user devstack@n-api.service[72695]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1614273784', 'metadata': {'Type': 'work'}}}} Apr 12 07:43:55 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise error Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi '0' Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-df5bb5fe-d9e3-4ec1-b758-b07e1b8fa839 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-df5bb5fe-d9e3-4ec1-b758-b07e1b8fa839 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013148 Apr 12 07:43:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 07:43:55 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ff3c3750-4cd3-400d-b3f0-80762384c7d9 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Action: 'create', calling method: .version_select at 0x7f7c0557bb50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-335688481", "metadata": {"Type": "work"}}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ff3c3750-4cd3-400d-b3f0-80762384c7d9 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72697]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72697]: Content-Length: 118 Apr 12 07:43:55 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72697]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72697]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72697]: Apr 12 07:43:55 user devstack@n-api.service[72697]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-335688481", "metadata": {"Type": "work"}}} Apr 12 07:43:55 user devstack@n-api.service[72697]: method: Apr 12 07:43:55 user devstack@n-api.service[72697]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72697]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-335688481', 'metadata': {'Type': 'work'}}}} Apr 12 07:43:55 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise error Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi '' Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 07:43:55 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ff3c3750-4cd3-400d-b3f0-80762384c7d9 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-ff3c3750-4cd3-400d-b3f0-80762384c7d9 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010836 Apr 12 07:43:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 07:43:55 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-21fefd03-ce45-4810-9263-26f68c39ab22 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Calling method '.version_select at 0x7f7c0546b520>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-21fefd03-ce45-4810-9263-26f68c39ab22 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] HTTP exception thrown: Volume tempest-invalid-2071601540 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-21fefd03-ce45-4810-9263-26f68c39ab22 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2071601540 HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: method: Apr 12 07:43:55 user devstack@n-api.service[72696]: exception: Volume tempest-invalid-2071601540 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: action_args: {'id': 'tempest-invalid-2071601540'} Apr 12 07:43:55 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2071601540 could not be found. (HTTP 404) (Request-ID: req-bcd4c766-40ed-4422-9d78-decde1c5789d) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2071601540 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2071601540 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2071601540 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-21fefd03-ce45-4810-9263-26f68c39ab22 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 404 to user: Volume tempest-invalid-2071601540 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-21fefd03-ce45-4810-9263-26f68c39ab22 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2071601540" status: 404 len: 99 microversion: 2.1 time: 0.057707 Apr 12 07:43:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 07:43:55 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2071601540 => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-758a69ea-5ab8-4cb2-ae3a-abf6a8815bd5 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009068 Apr 12 07:43:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 07:43:55 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8e342081-7685-4739-a53d-20be8b8c3541 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003670 Apr 12 07:43:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 07:43:55 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3ea87bb9-f549-49b5-9673-25a3c59f96e8 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Calling method '.version_select at 0x7f7c051225f0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-3ea87bb9-f549-49b5-9673-25a3c59f96e8 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] HTTP exception thrown: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3ea87bb9-f549-49b5-9673-25a3c59f96e8 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/os-volumes/22aab8dd-9c0f-49d8-9d45-2bad6a322046 HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72696]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:43:55 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72696]: method: Apr 12 07:43:55 user devstack@n-api.service[72696]: exception: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: action_args: {'id': '22aab8dd-9c0f-49d8-9d45-2bad6a322046'} Apr 12 07:43:55 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. (HTTP 404) (Request-ID: req-dff40fe2-50e9-4ac1-a80e-a20ef7557c70) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3ea87bb9-f549-49b5-9673-25a3c59f96e8 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 404 to user: Volume 22aab8dd-9c0f-49d8-9d45-2bad6a322046 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3ea87bb9-f549-49b5-9673-25a3c59f96e8 tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/22aab8dd-9c0f-49d8-9d45-2bad6a322046" status: 404 len: 109 microversion: 2.1 time: 0.038856 Apr 12 07:43:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 07:43:55 2023] DELETE /compute/v2.1/os-volumes/22aab8dd-9c0f-49d8-9d45-2bad6a322046 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eca5973b-a8f6-4892-906b-dac0faec5aea tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Calling method '.version_select at 0x7f7c053e2170>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-eca5973b-a8f6-4892-906b-dac0faec5aea tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] HTTP exception thrown: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eca5973b-a8f6-4892-906b-dac0faec5aea tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Request method failure captured: Apr 12 07:43:55 user devstack@n-api.service[72695]: request: GET /compute/v2.1/os-volumes/a0492130-1038-4acb-89db-0b166310eb56 HTTP/1.1 Apr 12 07:43:55 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:43:55 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:43:55 user devstack@n-api.service[72695]: Connection: close Apr 12 07:43:55 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:43:55 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:43:55 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:43:55 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:43:55 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmE6CtW9mjAuJpV6m19PKjm-icjgh90-ctPZseKoyjX5LD6Bhu7lLbMLwalZvoapS24dqmiotumT2OLdc4c8ZKQ8jlE2HXoTxl6Axj6Ne01gnbFvlZN8KiPk0lsq0t_MYSM9dAPi4gu9-2SRpDQoT4GqwAinBlrDScQW08bvSlIH1mE Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/119588e006f44cf8be9340d6de116d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/119588e006f44cf8be9340d6de116d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant-Id: 119588e006f44cf8be9340d6de116d35 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesNegativeTest-1437277452 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Id: c6dfe481b4a544e4b38f6451da86e7a8 Apr 12 07:43:55 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesNegativeTest-1437277452-project-member Apr 12 07:43:55 user devstack@n-api.service[72695]: method: Apr 12 07:43:55 user devstack@n-api.service[72695]: exception: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72695]: action_args: {'id': 'a0492130-1038-4acb-89db-0b166310eb56'} Apr 12 07:43:55 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. (HTTP 404) (Request-ID: req-d4deae83-c685-413a-8ee1-322659c0e0a6) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. Apr 12 07:43:55 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eca5973b-a8f6-4892-906b-dac0faec5aea tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] Returning 404 to user: Volume a0492130-1038-4acb-89db-0b166310eb56 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-eca5973b-a8f6-4892-906b-dac0faec5aea tempest-VolumesNegativeTest-1437277452 tempest-VolumesNegativeTest-1437277452-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a0492130-1038-4acb-89db-0b166310eb56" status: 404 len: 109 microversion: 2.1 time: 0.059113 Apr 12 07:43:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 07:43:55 2023] GET /compute/v2.1/os-volumes/a0492130-1038-4acb-89db-0b166310eb56 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:56 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff"}, {"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Creating event network-changed:b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:43:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] Creating event network-changed:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:43:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-33ea2d6d-db90-4ad7-9b6f-053ebbe2056b req-b914936f-161d-4a2a-ba9a-c0574e22caf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070206 Apr 12 07:43:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:56 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:43:58 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=14 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:43:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] Creating event network-changed:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:43:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-2a715b80-fc87-47c3-88ca-abfb48162802 req-da4a2201-d667-44c7-84fb-144bd43d09a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040984 Apr 12 07:43:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] [instance: eee310e4-bed8-405f-bfc6-a6bc3085293d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:43:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] HTTP exception thrown: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Request method failure captured: Apr 12 07:43:59 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d HTTP/1.1 Apr 12 07:43:59 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:43:59 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:43:59 user devstack@n-api.service[72695]: Connection: close Apr 12 07:43:59 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:43:59 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:43:59 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:43:59 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:43:59 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAd0y9J_Ifhekfs3qi0NCdALgyAj2QvqQsS6vEUP50aPrcWgEn3HIxuOJU-VbZcl4yJogdC4v0pXVLph7dQaycKGnMdwtTmkwgYeXpDsYXqGDo7O6Ap5B-3P91HlYvrJ_LCqdeSa2_99HxDvu8gD0kM2JfUvaefOQ-lCjDqZos_Y4Y Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Project-Id: 0e5fc0e264e047c1b874854907be678e Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestVolumeSwap-564837731 Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e5fc0e264e047c1b874854907be678e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e5fc0e264e047c1b874854907be678e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e5fc0e264e047c1b874854907be678e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Tenant: tempest-TestVolumeSwap-564837731 Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Tenant-Id: 0e5fc0e264e047c1b874854907be678e Apr 12 07:43:59 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestVolumeSwap-564837731 Apr 12 07:43:59 user devstack@n-api.service[72695]: X-User: tempest-TestVolumeSwap-564837731-project-member Apr 12 07:43:59 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:43:59 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:43:59 user devstack@n-api.service[72695]: X-User-Id: f9750ae336a14eb3b0bcc849aa67a026 Apr 12 07:43:59 user devstack@n-api.service[72695]: X-User-Name: tempest-TestVolumeSwap-564837731-project-member Apr 12 07:43:59 user devstack@n-api.service[72695]: method: > Apr 12 07:43:59 user devstack@n-api.service[72695]: exception: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. Apr 12 07:43:59 user devstack@n-api.service[72695]: action_args: {'id': 'eee310e4-bed8-405f-bfc6-a6bc3085293d'} Apr 12 07:43:59 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. Apr 12 07:43:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:43:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Returning 404 to user: Instance eee310e4-bed8-405f-bfc6-a6bc3085293d could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:43:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6b4d406e-ebee-4040-aca7-942f0ce86c89 tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d" status: 404 len: 111 microversion: 2.1 time: 0.038912 Apr 12 07:43:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:43:59 2023] GET /compute/v2.1/servers/eee310e4-bed8-405f-bfc6-a6bc3085293d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:43:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-12bc1b48-2d3c-427f-8c2a-e0b2ef6e9ddd tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] Calling method '.version_select at 0x7f7c05209c60>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:43:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-12bc1b48-2d3c-427f-8c2a-e0b2ef6e9ddd tempest-TestVolumeSwap-564837731 tempest-TestVolumeSwap-564837731-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332528006" status: 202 len: 0 microversion: 2.1 time: 0.034500 Apr 12 07:43:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 07:43:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332528006 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:44:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}, {"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Creating event network-changed:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] Creating event network-changed:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-e7c0f628-3234-4b3e-9998-c4b7bb300381 req-f4f373de-72ee-4f11-801d-0f9d4b758555 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036985 Apr 12 07:44:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:44:05 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 HTTP/1.1 Apr 12 07:44:05 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:44:05 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:44:05 user devstack@n-api.service[72695]: Connection: close Apr 12 07:44:05 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:44:05 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:44:05 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:44:05 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:44:05 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72695]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:44:05 user devstack@n-api.service[72695]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72695]: method: > Apr 12 07:44:05 user devstack@n-api.service[72695]: exception: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72695]: action_args: {'id': '98cb3965-b028-474d-90b3-b8c6f33b62a2'} Apr 12 07:44:05 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:44:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fb0d988c-c6c9-47bf-acf9-d4a80aa4ab46 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 404 len: 111 microversion: 2.1 time: 0.036280 Apr 12 07:44:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 109/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:05 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:44:05 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 HTTP/1.1 Apr 12 07:44:05 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:44:05 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:44:05 user devstack@n-api.service[72697]: Connection: close Apr 12 07:44:05 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:44:05 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:44:05 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:44:05 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:44:05 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72697]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:44:05 user devstack@n-api.service[72697]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72697]: method: > Apr 12 07:44:05 user devstack@n-api.service[72697]: exception: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72697]: action_args: {'id': '98cb3965-b028-474d-90b3-b8c6f33b62a2'} Apr 12 07:44:05 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:44:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2c3ac335-c66f-40fd-91b5-2199f1601ba3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 404 len: 111 microversion: 2.1 time: 0.045565 Apr 12 07:44:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 111/331] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:44:05 2023] DELETE /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 98cb3965-b028-474d-90b3-b8c6f33b62a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:44:05 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 HTTP/1.1 Apr 12 07:44:05 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:44:05 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:44:05 user devstack@n-api.service[72696]: Connection: close Apr 12 07:44:05 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:44:05 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:44:05 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:44:05 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:44:05 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:44:05 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:44:05 user devstack@n-api.service[72696]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:44:05 user devstack@n-api.service[72696]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:44:05 user devstack@n-api.service[72696]: method: > Apr 12 07:44:05 user devstack@n-api.service[72696]: exception: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72696]: action_args: {'id': '98cb3965-b028-474d-90b3-b8c6f33b62a2'} Apr 12 07:44:05 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. Apr 12 07:44:05 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 98cb3965-b028-474d-90b3-b8c6f33b62a2 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:44:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-540052db-0ea8-49a7-8ff5-2d9759fcb4ab tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2" status: 404 len: 111 microversion: 2.1 time: 0.037851 Apr 12 07:44:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:05 2023] GET /compute/v2.1/servers/98cb3965-b028-474d-90b3-b8c6f33b62a2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:44:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-12f0732a-9c33-4d7a-bee8-cc65ebfa5782 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/action" status: 200 len: 32 microversion: 2.1 time: 0.174703 Apr 12 07:44:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 110/333] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:44:08 2023] POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:08 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6e5e37c9-f868-4f75-8ee0-540bc150cff8 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1508 microversion: 2.1 time: 0.589716 Apr 12 07:44:08 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:08 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:08 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c3febb44-8279-45cb-a48e-a20591733aa0 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.516812 Apr 12 07:44:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:08 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:10 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-unplugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] Creating event network-vif-unplugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:44:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-52e4928b-20d9-4551-9267-5e306f05e700 req-82445e35-e58c-49f4-978c-efc9eb426d58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047165 Apr 12 07:44:10 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:11 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e53d0e83-1454-4e93-aef9-cdcfbf0ec1b3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1701 microversion: 2.1 time: 0.327961 Apr 12 07:44:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:11 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1701 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] Creating event network-vif-plugged:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-266a5b74-3910-4c33-92c7-79e1237b2a8b req-156c68a5-e95d-40f9-8f33-ae5f7ac4e47c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075063 Apr 12 07:44:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 114/338] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:44:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-ad8b1a0b-7326-4136-9953-0ee1e28aadea req-71272892-72e0-4a5c-9778-23c4f180de38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071594 Apr 12 07:44:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "7d15bdba-2895-4995-93c4-a687e1b18ae7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] Creating event network-vif-plugged:7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-cd9ac3ca-e0e6-4674-99ea-cba0334a79b4 req-93031d17-58e3-4c7a-ad2f-bbea0b0dc72b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083938 Apr 12 07:44:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1614827921", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "50d3d191-8644-4001-b806-929d0e869a72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:12 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:44:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Creating event network-vif-plugged:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Creating event network-vif-plugged:b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] Creating event network-vif-plugged:b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-bebdf948-4aef-4508-a904-79d187aa35d4 req-f6e7da2c-354e-417a-b356-6e974fa50219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047353 Apr 12 07:44:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:44:13 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50d3d191-8644-4001-b806-929d0e869a72',volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:44:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4fe0b7a2-4545-477c-a71c-e22ba492c934 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.564477 Apr 12 07:44:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 115/342] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:44:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:44:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-adbaa405-1f34-4a03-8df4-dbf4a0fc0ead tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-adbaa405-1f34-4a03-8df4-dbf4a0fc0ead tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-adbaa405-1f34-4a03-8df4-dbf4a0fc0ead tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-adbaa405-1f34-4a03-8df4-dbf4a0fc0ead tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 200 len: 1066 microversion: 2.1 time: 0.079327 Apr 12 07:44:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:14 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 1066 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:44:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-f5506fe6-0d21-4707-930b-d1c7ff37772a req-3727b12c-4535-4caa-bf30-db11090cdcc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031366 Apr 12 07:44:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "7d15bdba-2895-4995-93c4-a687e1b18ae7"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Creating event network-vif-plugged:7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] Creating event network-vif-plugged:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-158d4b92-d1fe-4d8a-b182-76614a3c42f8 req-33ac3674-c15f-46b3-96a6-e6dc1a7a4919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057862 Apr 12 07:44:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=25 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:15 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-090d88d4-a049-4355-b722-8e015ffd48ed tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1705 microversion: 2.1 time: 0.189632 Apr 12 07:44:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:15 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1705 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Creating event network-vif-plugged:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] Creating event network-vif-plugged:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-edc04f13-f187-4388-aced-a4b7c2bb1274 req-0ebed999-4722-4775-bb33-67d48b25c23e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047290 Apr 12 07:44:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:44:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Creating event network-vif-plugged:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] Creating event network-vif-plugged:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-e18c4ec6-6381-4550-82e0-62b0ad160846 req-053e6b4e-806b-4ed4-869b-7911879f3ea9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046262 Apr 12 07:44:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Creating event network-vif-plugged:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Creating event network-vif-plugged:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] Creating event network-vif-plugged:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:44:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a0137c09-635d-41b2-80bf-6585ebb69e21 req-3e477f8f-044a-4d25-b53e-0a0e7397779b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035383 Apr 12 07:44:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:19 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] Creating event network-changed:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:44:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-c646a1d5-d92d-4568-a758-1949291ebd6c req-9c7d8370-9adb-4537-a031-55d8ba331069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062257 Apr 12 07:44:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=25 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "name": "network-vif-plugged", "status": "completed", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] Creating event network-vif-plugged:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:44:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-1a6786aa-6c32-45e5-bbd8-d9db125405aa req-a1db0e7e-cc5a-4653-be0e-2bb558b1478c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068472 Apr 12 07:44:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=7 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "name": "network-vif-plugged", "status": "completed", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] Creating event network-vif-plugged:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:44:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-b25697c2-943b-443c-98fd-4c38da078322 req-2448aa67-ff8b-40a0-8bbe-44b3a6212353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039101 Apr 12 07:44:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:33 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=15 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:33 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=7 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:33 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1768d611-5692-4c68-8819-de2d543bb0c9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: .version_select at 0x7f7c053e27a0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-33494310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKY3IfLbQtlg9TTvQ4KUShSpDfiYSwffhY1f5sy0yXcOfZzR2YPa+yu4MsobcQPV5jgbrwG1tvBCtM7wUngdWCr1fKuPVs1PI6G5g3xFfWG8LfUY5f9YX3pJC+Y/2sgug=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:33 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-1768d611-5692-4c68-8819-de2d543bb0c9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting quotas for project 7dbbd1aa653244a39d6c81f2b9d669f5. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:44:33 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-1768d611-5692-4c68-8819-de2d543bb0c9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting quotas for user 775732b835f44e7baf889683808bb3dd and project 7dbbd1aa653244a39d6c81f2b9d669f5. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:44:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1768d611-5692-4c68-8819-de2d543bb0c9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.252636 Apr 12 07:44:33 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 117/353] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:44:33 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5c7a716d-c0bc-4aea-acec-93339897562e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 200 len: 2819 microversion: 2.32 time: 0.242456 Apr 12 07:44:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 119/354] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:44:34 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 2819 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:44:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1352660305", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-33494310", "security_groups": [{"name": "tempest-secgroup-smoke-585863165"}], "networks": [{"uuid": "6599b73f-f1e9-42c9-a7bf-8208291d4abf"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] validate_networks() for [('6599b73f-f1e9-42c9-a7bf-8208291d4abf', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting quotas for project 7dbbd1aa653244a39d6c81f2b9d669f5. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Getting quotas for user 775732b835f44e7baf889683808bb3dd and project 7dbbd1aa653244a39d6c81f2b9d669f5. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:44:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:44:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0ab68965-50b3-4c67-aaf4-dc0b40484f3d tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.871876 Apr 12 07:44:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:44:34 2023] POST /compute/v2.1/servers => generated 403 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 07:44:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-2783da7f-c451-4af0-8019-56d99a2a5c7b tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-2783da7f-c451-4af0-8019-56d99a2a5c7b tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:35 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-2783da7f-c451-4af0-8019-56d99a2a5c7b tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775732b835f44e7baf889683808bb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbd1aa653244a39d6c81f2b9d669f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-2783da7f-c451-4af0-8019-56d99a2a5c7b tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 200 len: 1255 microversion: 2.1 time: 0.122812 Apr 12 07:44:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 118/356] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:35 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 1255 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:38 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] Creating event network-changed:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:44:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d4445e30-b1ae-4cfb-a06e-595522679a7e req-5c180180-ce14-4e75-b09a-262f88b55dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097430 Apr 12 07:44:38 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "name": "network-vif-plugged", "status": "completed", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] Creating event network-vif-plugged:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:44:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6040eebd-e1d1-4f27-ace1-ae9424eaa60f req-1eac466f-37b3-4012-a5c4-ffc750e7fb0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045044 Apr 12 07:44:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "name": "network-vif-plugged", "status": "completed", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] Creating event network-vif-plugged:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:44:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-78e85576-6d66-4946-888b-d2474836c2fc req-0b58f0c3-def3-488a-b6d3-6f1eaf1f4e5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049859 Apr 12 07:44:43 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 119/359] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "94515e68-60bf-41e6-9d56-6d8cc8837036"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] HTTP exception thrown: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Request method failure captured: Apr 12 07:44:45 user devstack@n-api.service[72696]: request: PUT /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7/os-volume_attachments/74e21241-811c-41be-a584-e929abd81800 HTTP/1.1 Apr 12 07:44:45 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:44:45 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:44:45 user devstack@n-api.service[72696]: Connection: close Apr 12 07:44:45 user devstack@n-api.service[72696]: Content-Length: 74 Apr 12 07:44:45 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:44:45 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:44:45 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:44:45 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmBHpJqAS9HhTJNsoRxBAMPjatgZKxmTPUd07hMJc9vlfW5k2njeFRf2jIaCPMz9ijXwKfwkLhix4MKSZgpg_tnVLGEwGOV-0GAaaIwFVrhq_37otyQKd9ad-SzobAZimhH7by2MkUYgPUFpLyaTWRuvRw_oVObvAzOntD7AehgWZCU Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Project-Id: 644e093321884f69aa8cc2f21dbdbae4 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Role: admin,member,reader Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Roles: admin,member,reader Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/644e093321884f69aa8cc2f21dbdbae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Tenant-Id: 644e093321884f69aa8cc2f21dbdbae4 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506017688 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-User: tempest-VolumesAdminNegativeTest-1506017688-project-admin Apr 12 07:44:45 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:44:45 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:44:45 user devstack@n-api.service[72696]: X-User-Id: d824602fce7043bc85f9ddf7950a0539 Apr 12 07:44:45 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesAdminNegativeTest-1506017688-project-admin Apr 12 07:44:45 user devstack@n-api.service[72696]: Apr 12 07:44:45 user devstack@n-api.service[72696]: {"volumeAttachment": {"volumeId": "94515e68-60bf-41e6-9d56-6d8cc8837036"}} Apr 12 07:44:45 user devstack@n-api.service[72696]: method: > Apr 12 07:44:45 user devstack@n-api.service[72696]: exception: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. Apr 12 07:44:45 user devstack@n-api.service[72696]: action_args: {'server_id': '4820ef5a-bb6b-4b54-987b-071d51bca7d7', 'id': '74e21241-811c-41be-a584-e929abd81800', 'body': {'volumeAttachment': {'volumeId': '94515e68-60bf-41e6-9d56-6d8cc8837036'}}} Apr 12 07:44:45 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. (HTTP 404) (Request-ID: req-ff7442b1-26fd-4aab-935b-6be5067a5c0a) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. Apr 12 07:44:45 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] Returning 404 to user: Volume 74e21241-811c-41be-a584-e929abd81800 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:44:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c5c3da4b-1d5b-47d9-b8e1-cd68c5082920 tempest-VolumesAdminNegativeTest-1506017688 tempest-VolumesAdminNegativeTest-1506017688-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7/os-volume_attachments/74e21241-811c-41be-a584-e929abd81800" status: 404 len: 109 microversion: 2.1 time: 0.116261 Apr 12 07:44:45 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 121/360] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 07:44:45 2023] PUT /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7/os-volume_attachments/74e21241-811c-41be-a584-e929abd81800 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:49 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:44:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-38a3f3f0-b546-4edd-b9bb-d2a7b64ba2cf tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7" status: 204 len: 0 microversion: 2.1 time: 0.197020 Apr 12 07:44:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:44:48 2023] DELETE /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:49 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9cd81aed-7bd9-4881-b495-a088061af231 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7" status: 200 len: 1502 microversion: 2.1 time: 0.210907 Apr 12 07:44:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:49 2023] GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:49 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "name": "network-vif-unplugged", "status": "completed", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:49 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] Creating event network-vif-unplugged:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:44:49 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-69e47737-9eb5-4a98-aae7-d8d9f45ab380 req-a210521b-088f-4dc8-8a2e-5dde9713b1fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.237061 Apr 12 07:44:49 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "name": "network-vif-deleted", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] Creating event network-vif-deleted:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:44:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-eebe47c9-1f1e-4bee-b26f-052900fcc053 req-e131064d-e554-4f2f-bdfb-a26d7b88798c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 Apr 12 07:44:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:52 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4820ef5a-bb6b-4b54-987b-071d51bca7d7", "name": "network-vif-plugged", "status": "completed", "tag": "3047f54e-67d3-4ca8-8e19-a5d01ba1db57"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] Creating event network-vif-plugged:3047f54e-67d3-4ca8-8e19-a5d01ba1db57 for instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 on user Apr 12 07:44:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7f096bf4-509c-4d02-a26a-b2e153d5b744 req-47aed92d-03c3-4e91-a392-05bce899e74e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Apr 12 07:44:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 121/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:44:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-110d9493-a9b7-48a2-a6d5-0fe5372ce8b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1057221505", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6f869841-1ed6-423d-80d8-7d193cf5eedb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:44:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-110d9493-a9b7-48a2-a6d5-0fe5372ce8b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] HTTP exception thrown: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. Apr 12 07:44:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-110d9493-a9b7-48a2-a6d5-0fe5372ce8b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:44:55 user devstack@n-api.service[72696]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 07:44:55 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:44:55 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:44:55 user devstack@n-api.service[72696]: Connection: close Apr 12 07:44:55 user devstack@n-api.service[72696]: Content-Length: 357 Apr 12 07:44:55 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:44:55 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:44:55 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:44:55 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:44:55 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:44:55 user devstack@n-api.service[72696]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:44:55 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:44:55 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:44:55 user devstack@n-api.service[72696]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:44:55 user devstack@n-api.service[72696]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:44:55 user devstack@n-api.service[72696]: Apr 12 07:44:55 user devstack@n-api.service[72696]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1057221505", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6f869841-1ed6-423d-80d8-7d193cf5eedb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} Apr 12 07:44:55 user devstack@n-api.service[72696]: method: > Apr 12 07:44:55 user devstack@n-api.service[72696]: exception: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. Apr 12 07:44:55 user devstack@n-api.service[72696]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1057221505', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6f869841-1ed6-423d-80d8-7d193cf5eedb'}], 'networks': [{'uuid': '44ded1bd-af51-4bee-bb78-604e95e530cf'}]}}} Apr 12 07:44:55 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. Apr 12 07:44:55 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:44:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-110d9493-a9b7-48a2-a6d5-0fe5372ce8b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 400 to user: Block Device 6f869841-1ed6-423d-80d8-7d193cf5eedb is not bootable. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:44:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-110d9493-a9b7-48a2-a6d5-0fe5372ce8b2 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.076316 Apr 12 07:44:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 123/366] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:44:55 2023] POST /compute/v2.1/servers => generated 110 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:55 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-45f91e74-522f-4d9c-8b15-bffa0b368f52 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1492 microversion: 2.1 time: 0.150006 Apr 12 07:44:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:55 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1492 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:44:59 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:44:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-11f8a22c-6416-44a7-a8e8-4476ae3d6a12 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1488 microversion: 2.1 time: 0.282972 Apr 12 07:44:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:44:58 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1488 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=16 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=13 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:04 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-eb83d174-37dd-4f99-9b86-21d3a857415a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 200 len: 1393 microversion: 2.1 time: 0.167224 Apr 12 07:45:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:04 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:08 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:08 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:09 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-47b8d781-d3b3-4607-9e50-d226577d9844 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.324221 Apr 12 07:45:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:08 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=16 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:09 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-74064fd9-fdb7-4178-9e47-db9a816c09c4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.154480 Apr 12 07:45:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 123/371] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:09 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:11 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'services' on Instance uuid f79ca8ec-41b5-4b60-882f-d74d906fb8e6 {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:45:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2c018bdf-1a21-4ae3-8482-d1f7a1cb9992 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments/d264d7ac-e4d5-48b7-b5f8-11b463caef9f" status: 202 len: 0 microversion: 2.1 time: 0.332098 Apr 12 07:45:12 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:45:11 2023] DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments/d264d7ac-e4d5-48b7-b5f8-11b463caef9f => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:45:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Going to try to stop instance {{(pid=72697) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 07:45:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-48bf1d00-2c32-484a-91ff-1b895e9abec9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.108925 Apr 12 07:45:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 125/373] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:45:14 2023] POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:14 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b9900fd6-e1d1-47d5-a988-f793952d89ea tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1665 microversion: 2.1 time: 0.200411 Apr 12 07:45:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:14 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1665 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] Creating event network-vif-unplugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:45:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c3d5cda0-63c4-466b-8ceb-e02ca799816c req-fc740ea4-e5e4-4443-95f9-667b72ce846b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088348 Apr 12 07:45:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 126/375] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-13dfb6bb-6a52-4707-b68d-ae2443421453 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action" status: 202 len: 0 microversion: 2.1 time: 0.200949 Apr 12 07:45:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 126/376] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:45:15 2023] POST /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-5ace5782-c1b3-47f1-969f-6a6ed168c263 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.121993 Apr 12 07:45:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 125/377] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:45:15 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-interface => generated 283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-unplugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] Creating event network-vif-unplugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-336dc26f-e9d5-46d7-8bbc-4c8454ddd6e1 req-059a11fe-3ee4-401a-96c6-68555dfd4d0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033792 Apr 12 07:45:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:45:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6772dbea-d352-46af-bc06-7faac8668f7e req-c68479d4-d68e-4dfe-9b33-73c56984c11a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037173 Apr 12 07:45:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:18 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-2eaf26e3-3c58-4213-9781-bee65c3d1d72 req-1b18dc7b-dd28-4d4e-a799-311df8ab8afb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081914 Apr 12 07:45:18 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:18 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}, {"name": "network-changed", "server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:18 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Creating event network-changed:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] Creating event network-changed:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:18 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-492229d1-6cb7-4f7e-adc3-f11990dbb3a9 req-5e993ed3-0b22-4f17-961a-1573c9df66e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110871 Apr 12 07:45:18 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:18 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}, {"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:45:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-be3de850-a015-460f-868e-8c065dceeec1 req-b643d323-509f-4be4-ae9d-0581e92802f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035987 Apr 12 07:45:20 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:26 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775732b835f44e7baf889683808bb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbd1aa653244a39d6c81f2b9d669f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e13bdeba-d610-4629-a122-960560033af8 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 200 len: 1566 microversion: 2.1 time: 0.199598 Apr 12 07:45:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 127/383] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:26 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=9 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-fc7cb0f1-570c-491b-8911-e910e043b0b1 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.156893 Apr 12 07:45:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 07:45:34 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47/os-interface => generated 1829 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=10 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] Creating event network-changed:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-5970774b-04ca-433b-9405-0d4ea3e1258e req-1bf63217-f11a-44a6-92f7-fbabbe3611ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040322 Apr 12 07:45:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-695d0d27-6416-47fb-a25b-e24181ac804e tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 200 len: 2819 microversion: 2.32 time: 0.343625 Apr 12 07:45:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:45:35 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 2819 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-67160ee3-0cc2-4c80-91d8-05c927641882 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.136482 Apr 12 07:45:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 130/387] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 07:45:36 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47/os-interface => generated 1829 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:45:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-09538cb8-d7b9-461f-8690-f0de9cebba67 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 204 len: 0 microversion: 2.32 time: 0.122996 Apr 12 07:45:37 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 130/388] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:45:37 2023] DELETE /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:37 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6ae1f3ccb2845fb9479448b50a0b919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9766adb34464a8991764937c0f755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-626a4037-73c4-4f29-95ed-e9154afe23eb tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 200 len: 2944 microversion: 2.32 time: 0.207362 Apr 12 07:45:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 129/389] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:45:37 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 2944 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:45:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] Creating event network-vif-unplugged:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-08a1507a-dbf7-4577-947c-44d453fbc38f req-2678b98a-9a56-41e6-98d2-44f19e65711a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031286 Apr 12 07:45:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "7d15bdba-2895-4995-93c4-a687e1b18ae7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] Creating event network-vif-unplugged:7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-000aa58c-0e5c-4930-a5bd-6c513f80b85e req-c10edcf1-8329-428a-94b4-ede5b368c379 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035222 Apr 12 07:45:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 131/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] Creating event network-vif-unplugged:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-65efb7fc-da1f-401c-af1e-e430e66c71d5 req-6248e224-314d-4931-a8f4-4d605b3b7c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034265 Apr 12 07:45:38 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: 4820ef5a-bb6b-4b54-987b-071d51bca7d7] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] HTTP exception thrown: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Request method failure captured: Apr 12 07:45:39 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 HTTP/1.1 Apr 12 07:45:39 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:45:39 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:45:39 user devstack@n-api.service[72696]: Connection: close Apr 12 07:45:39 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:45:39 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:45:39 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:45:39 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:45:39 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAkdQ08DWOsEFYUi7bbLhqgUKHYBmBZ6KaQJbxuIiAx0tooeZprGPYWtDX5FEDUEI7QtFFIerSDuP7J7z-TDBc1P41XPqRxlkpw3VQyvOD1hWrYY2nHfrqDP1veaoQfqdOYjVgoOxu1VzNzYC03NJU36Ok5mGCCswiQ2EyClEN7cAw Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Project-Id: 19a93f4d88764fd49cd8b2eb9ff1cb8f Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Tenant-Id: 19a93f4d88764fd49cd8b2eb9ff1cb8f Apr 12 07:45:39 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:45:39 user devstack@n-api.service[72696]: X-User: tempest-VolumesAdminNegativeTest-407566417-project-member Apr 12 07:45:39 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:45:39 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:45:39 user devstack@n-api.service[72696]: X-User-Id: 8de4929e67ed472b90e95066b2c50340 Apr 12 07:45:39 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesAdminNegativeTest-407566417-project-member Apr 12 07:45:39 user devstack@n-api.service[72696]: method: > Apr 12 07:45:39 user devstack@n-api.service[72696]: exception: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. Apr 12 07:45:39 user devstack@n-api.service[72696]: action_args: {'id': '4820ef5a-bb6b-4b54-987b-071d51bca7d7'} Apr 12 07:45:39 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. Apr 12 07:45:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:45:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Returning 404 to user: Instance 4820ef5a-bb6b-4b54-987b-071d51bca7d7 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:45:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c10330e1-6d43-40aa-8838-1a054a5c4398 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7" status: 404 len: 111 microversion: 2.1 time: 0.188646 Apr 12 07:45:39 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 132/393] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:39 2023] GET /compute/v2.1/servers/4820ef5a-bb6b-4b54-987b-071d51bca7d7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:45:40 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "7d15bdba-2895-4995-93c4-a687e1b18ae7"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Creating event network-vif-plugged:7d15bdba-2895-4995-93c4-a687e1b18ae7 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Creating event network-vif-unplugged:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Creating event network-vif-plugged:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Creating event network-vif-unplugged:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] Creating event network-vif-plugged:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ce0a8e1c-5955-4ac2-83e8-82c64a20b51e req-3dd41acc-0653-468c-a595-31cabe23a334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.039993 Apr 12 07:45:40 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "b07e4269-65c3-4fc9-9eaf-bb063b07f3ff"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=17 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=39 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Creating event network-vif-plugged:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Creating event network-vif-unplugged:b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Creating event network-vif-plugged:b07e4269-65c3-4fc9-9eaf-bb063b07f3ff for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Creating event network-vif-unplugged:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] Creating event network-vif-plugged:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-82cd0dc8-5384-4eb5-aecb-9dbf00ab65f3 req-81c63ec4-029e-4a46-8488-6549419269f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.038452 Apr 12 07:45:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:40 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-plugged", "status": "completed", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:40 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] Creating event network-vif-plugged:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:40 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-fd88aa9e-380c-4c49-8500-fd9051069369 req-a2944312-c16e-4bac-99d0-d643209251e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Apr 12 07:45:40 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:45:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a5266db7-d30f-4c9c-8e16-0ccbcf76b2ea tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614" status: 204 len: 0 microversion: 2.1 time: 0.121554 Apr 12 07:45:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:45:41 2023] DELETE /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:42 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de4929e67ed472b90e95066b2c50340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a93f4d88764fd49cd8b2eb9ff1cb8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d5fe4c0e-eeeb-4e62-8c76-dcb6ab720380 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614" status: 200 len: 1668 microversion: 2.1 time: 0.261618 Apr 12 07:45:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 132/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:41 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "name": "network-vif-unplugged", "status": "completed", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] Creating event network-vif-unplugged:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:45:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-8bc4dce4-f3ac-4aa6-80fa-46dff4e3dda7 req-7b856045-761e-4269-8ec1-ec751fe040a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033057 Apr 12 07:45:42 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 134/399] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-deleted", "tag": "b7143159-bbbd-45e7-a085-faf5e834569d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] Creating event network-vif-deleted:b7143159-bbbd-45e7-a085-faf5e834569d for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-fc983830-02f5-48f6-b730-146028620e68 req-7fa7c47e-5dbd-4188-bba4-8622ab810316 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037074 Apr 12 07:45:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 134/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "name": "network-vif-plugged", "status": "completed", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] Creating event network-vif-plugged:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:45:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a198a418-05d6-412f-a226-e7ae07ac7c13 req-871c6020-3b8b-40f7-a613-17b8f263c6a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 Apr 12 07:45:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 133/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-deleted", "tag": "54ea6af7-6239-4259-82dc-87e23894017a"}, {"server_uuid": "d4f9729d-3114-4fc6-a704-02f436c17614", "name": "network-vif-deleted", "tag": "f5da504b-425d-45d4-a150-7399af15f563"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-deleted", "tag": "9e1d8af4-ee87-40f8-b586-d000e0fa6653"}, {"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-deleted", "tag": "3c6de623-6a72-4ab8-a405-d9ffabab1f21"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Creating event network-vif-deleted:54ea6af7-6239-4259-82dc-87e23894017a for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Creating event network-vif-deleted:f5da504b-425d-45d4-a150-7399af15f563 for instance d4f9729d-3114-4fc6-a704-02f436c17614 on user Apr 12 07:45:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Creating event network-vif-deleted:9e1d8af4-ee87-40f8-b586-d000e0fa6653 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] Creating event network-vif-deleted:3c6de623-6a72-4ab8-a405-d9ffabab1f21 for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-61c18b14-5c64-4887-84d6-dfb308b5d124 req-c5924fc1-8e78-4296-8de3-726fce41dbeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038285 Apr 12 07:45:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:44 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a42e95-630c-43a0-9217-2fc72f859f47", "name": "network-vif-deleted", "tag": "ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] Creating event network-vif-deleted:ee6ca0d0-78ea-4fee-8bb7-d03b82d350bd for instance 32a42e95-630c-43a0-9217-2fc72f859f47 on user Apr 12 07:45:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ddad4de6-c6a5-4cab-a889-a38baaa3b63a req-5c605045-fe98-4eae-97d8-2b0c07d9ec60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Apr 12 07:45:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:48 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lazy-loading 'services' on Instance uuid 69aeabdc-65e3-4af2-9f8b-3699778c6b89 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:45:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4ac9c4c9-1cfd-4f45-8dfe-b83ff1809c91 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments/50ebd7de-6dee-4a5b-ba64-d910fb73e897" status: 202 len: 0 microversion: 2.1 time: 0.156718 Apr 12 07:45:48 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 134/404] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:45:48 2023] DELETE /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments/50ebd7de-6dee-4a5b-ba64-d910fb73e897 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c9d4ce0c-389a-4e87-b151-ff2299ca9489 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055343 Apr 12 07:45:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 136/405] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:45:48 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:55 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b22dd881-e916-4599-8a43-13aa703a62cb tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1492 microversion: 2.1 time: 0.203133 Apr 12 07:45:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:55 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=7 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd6c118d-19ce-4a38-bce0-e2652aca2601"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HTTP exception thrown: Cannot 'attach_volume' instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 while it is in vm_state rescued Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Request method failure captured: Apr 12 07:45:59 user devstack@n-api.service[72695]: request: POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/os-volume_attachments HTTP/1.1 Apr 12 07:45:59 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:45:59 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:45:59 user devstack@n-api.service[72695]: Connection: close Apr 12 07:45:59 user devstack@n-api.service[72695]: Content-Length: 74 Apr 12 07:45:59 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:45:59 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:45:59 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:45:59 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmApYBd1x96NhnzxJC1QeMpG6tce--NfjqdsPkOw2y6gWWoQ8C_3EPX9bzMrl2ph-KqNy8ZAghfFDICMU0hTH3dj1hOtNVzkLDZuUyrPb1R52gIpQ6lGvfalxiEHQJA5t0cmosu42zOnqWapFOQ49Nx7O3mKM1ktuBpyvSwcAIVuP58 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Project-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Tenant-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:45:59 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-User: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:45:59 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:45:59 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:45:59 user devstack@n-api.service[72695]: X-User-Id: 86009132a34b466399da1701f47316d9 Apr 12 07:45:59 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:45:59 user devstack@n-api.service[72695]: Apr 12 07:45:59 user devstack@n-api.service[72695]: {"volumeAttachment": {"volumeId": "dd6c118d-19ce-4a38-bce0-e2652aca2601"}} Apr 12 07:45:59 user devstack@n-api.service[72695]: method: > Apr 12 07:45:59 user devstack@n-api.service[72695]: exception: Cannot 'attach_volume' instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 while it is in vm_state rescued Apr 12 07:45:59 user devstack@n-api.service[72695]: action_args: {'server_id': 'e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2', 'body': {'volumeAttachment': {'volumeId': 'dd6c118d-19ce-4a38-bce0-e2652aca2601'}}} Apr 12 07:45:59 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 while it is in vm_state rescued Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 while it is in vm_state rescued Apr 12 07:45:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:45:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Returning 409 to user: Cannot 'attach_volume' instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 while it is in vm_state rescued {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:45:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-426d645f-8d3d-4374-956e-a1c64e58f602 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054584 Apr 12 07:45:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 135/407] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:45:59 2023] POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=16 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=24 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-6301b491-4c65-4864-b447-20290d168882 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/action" status: 202 len: 0 microversion: 2.1 time: 0.083629 Apr 12 07:45:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 137/408] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:45:59 2023] POST /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:45:59 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:45:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d16ba74d-9255-4726-a0be-9c1fa3f51648 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1496 microversion: 2.1 time: 0.242978 Apr 12 07:45:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:45:59 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1496 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-unplugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] Creating event network-vif-unplugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:46:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-39e8b556-b8e2-4197-aad4-9aa51bc8af23 req-588e69bf-52da-4906-81ac-3db76efc6367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029606 Apr 12 07:46:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 136/410] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}, {"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:46:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:46:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-4993176d-60c2-4940-a130-722332a7104d req-eba427a9-4eb0-4a60-acd1-f57e098f2d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031536 Apr 12 07:46:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 138/411] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:46:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-7524c6d7-33b2-4596-89d8-8236da043411 req-d9e7579b-0943-4150-8c4f-d02ec56a014b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027683 Apr 12 07:46:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-74ae7ff7-ba04-495e-8eae-6fd23c398bb0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1642 microversion: 2.1 time: 0.141466 Apr 12 07:46:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 139/413] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:04 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1642 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:04 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-20bdde2e-bdbf-4036-8bdf-62c1ac402eee tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 200 len: 1393 microversion: 2.1 time: 0.188215 Apr 12 07:46:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:04 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-962638813"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:04 user devstack@n-api.service[72697]: INFO nova.compute.api [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Attempting to quiesce instance before volume snapshot. Apr 12 07:46:05 user devstack@n-api.service[72697]: INFO nova.compute.api [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 07:46:05 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Creating snapshot from volume 50d3d191-8644-4001-b806-929d0e869a72. {{(pid=72697) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 07:46:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6a325f50-d5a3-4b36-bc5e-898742d343a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2/action" status: 202 len: 0 microversion: 2.1 time: 2.511881 Apr 12 07:46:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 139/415] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:46:04 2023] POST /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2/action => generated 0 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-749572181", "imageRef": "34ecb43c-aca7-4574-ae55-d63693cb2d4d", "flavorRef": "42", "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:46:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:46:08 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='32b6d063-9ea8-4ad2-8d90-96d8996c5e85',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:46:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-da778653-3044-49ca-9cab-ebe3e8e17f05 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.573348 Apr 12 07:46:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 140/416] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:46:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:46:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-80a475f0-3ec8-4671-836f-9a2449b15f73 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-80a475f0-3ec8-4671-836f-9a2449b15f73 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:08 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-80a475f0-3ec8-4671-836f-9a2449b15f73 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-80a475f0-3ec8-4671-836f-9a2449b15f73 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 200 len: 1223 microversion: 2.1 time: 0.063042 Apr 12 07:46:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 138/417] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:08 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 1223 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:09 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lazy-loading 'services' on Instance uuid 3b7424e4-52aa-4330-a748-006240372716 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:46:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d526681f-5572-431f-9c51-34d53e479620 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments/a63f5525-138b-4fd7-8ec1-59c92063ee9e" status: 202 len: 0 microversion: 2.1 time: 0.266193 Apr 12 07:46:10 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:46:09 2023] DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments/a63f5525-138b-4fd7-8ec1-59c92063ee9e => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-fb4c9e9c-b944-4c38-9b16-387750f5604c tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056667 Apr 12 07:46:10 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 141/419] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:46:10 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] Creating event network-changed:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:46:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a259aac6-9bc5-4194-ad38-2ae554fba880 req-fc9415a6-77eb-4fbc-a3dd-edd1318cdf11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035274 Apr 12 07:46:11 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "name": "network-vif-plugged", "status": "completed", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] Creating event network-vif-plugged:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:46:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ed094d59-4242-4ea1-a782-07a2f258d027 req-572beafe-00f5-4a0e-ae8a-d0fd414ddfab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037464 Apr 12 07:46:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "name": "network-vif-plugged", "status": "completed", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] Creating event network-vif-plugged:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:46:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-719415b8-b1a5-4364-9b47-dbcb9a1d266c req-01991581-0449-4820-a174-75b2e30dc013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062427 Apr 12 07:46:24 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 142/422] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=12 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=14 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:26 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775732b835f44e7baf889683808bb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbd1aa653244a39d6c81f2b9d669f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d3a9031d-2456-4f05-9341-f7fac77b8ada tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 200 len: 1566 microversion: 2.1 time: 0.207344 Apr 12 07:46:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:26 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HTTP exception thrown: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Request method failure captured: Apr 12 07:46:27 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 HTTP/1.1 Apr 12 07:46:27 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:46:27 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:46:27 user devstack@n-api.service[72697]: Connection: close Apr 12 07:46:27 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:46:27 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:46:27 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:46:27 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:46:27 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmEVyH8KJkygoCZmdMTMd57jLkSKNnMFf4nmlT2bV-hBewY4DHkElH1O9Bl0JDORmI8TJCmMDk-QztwRkxrujc24U9qNK6sEjjpX2BhALplpSkBhiT5GE3GDhHF4GXKyIEIABBN-6E8WZarATCGKL5bCPFcu4dXsvYim6tEDw56xeaI Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Project-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Project-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/57b9766adb34464a8991764937c0f755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Tenant: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Tenant-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-User: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:27 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:46:27 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:46:27 user devstack@n-api.service[72697]: X-User-Id: e6ae1f3ccb2845fb9479448b50a0b919 Apr 12 07:46:27 user devstack@n-api.service[72697]: X-User-Name: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:27 user devstack@n-api.service[72697]: method: > Apr 12 07:46:27 user devstack@n-api.service[72697]: exception: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:27 user devstack@n-api.service[72697]: action_args: {'id': '32a42e95-630c-43a0-9217-2fc72f859f47'} Apr 12 07:46:27 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:27 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Returning 404 to user: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:46:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-118736e5-9e1b-4e71-84ad-37944d4e2a83 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 404 len: 111 microversion: 2.32 time: 0.069907 Apr 12 07:46:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 142/424] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:46:27 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:46:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3623bbe7-d5fc-4996-9fba-6aafa3b4cec2 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '.version_select at 0x7f7c051cdc60>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3623bbe7-d5fc-4996-9fba-6aafa3b4cec2 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-765614204" status: 204 len: 0 microversion: 2.32 time: 0.027844 Apr 12 07:46:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 143/425] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 07:46:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-765614204 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:46:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] Creating event network-changed:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:46:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-1e0ee860-7f08-4b5b-8583-b92a258bdc07 req-e95f7044-e19e-4917-b4b5-8a9aeffb9214 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031098 Apr 12 07:46:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 141/426] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b3a52e6-052a-43bf-a817-207c82b3dc3b"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:30 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6df88fd1-1d4f-4ab9-9d0c-5e1391fbbcef tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308850 Apr 12 07:46:30 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 143/427] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:46:29 2023] POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HTTP exception thrown: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Request method failure captured: Apr 12 07:46:31 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 HTTP/1.1 Apr 12 07:46:31 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:46:31 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:46:31 user devstack@n-api.service[72696]: Connection: close Apr 12 07:46:31 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:46:31 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:46:31 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:46:31 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:46:31 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmEVyH8KJkygoCZmdMTMd57jLkSKNnMFf4nmlT2bV-hBewY4DHkElH1O9Bl0JDORmI8TJCmMDk-QztwRkxrujc24U9qNK6sEjjpX2BhALplpSkBhiT5GE3GDhHF4GXKyIEIABBN-6E8WZarATCGKL5bCPFcu4dXsvYim6tEDw56xeaI Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Project-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Project-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/57b9766adb34464a8991764937c0f755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Tenant: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Tenant-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-User: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:31 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:46:31 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:46:31 user devstack@n-api.service[72696]: X-User-Id: e6ae1f3ccb2845fb9479448b50a0b919 Apr 12 07:46:31 user devstack@n-api.service[72696]: X-User-Name: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:31 user devstack@n-api.service[72696]: method: > Apr 12 07:46:31 user devstack@n-api.service[72696]: exception: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72696]: action_args: {'id': '32a42e95-630c-43a0-9217-2fc72f859f47'} Apr 12 07:46:31 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Returning 404 to user: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:46:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4847cc53-d833-49b6-9067-f6e81f146d1c tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 404 len: 111 microversion: 2.32 time: 0.040746 Apr 12 07:46:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 144/428] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:46:31 2023] DELETE /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] [instance: 32a42e95-630c-43a0-9217-2fc72f859f47] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] HTTP exception thrown: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Request method failure captured: Apr 12 07:46:31 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 HTTP/1.1 Apr 12 07:46:31 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:46:31 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:46:31 user devstack@n-api.service[72695]: Connection: close Apr 12 07:46:31 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:46:31 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:46:31 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:46:31 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:46:31 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmEVyH8KJkygoCZmdMTMd57jLkSKNnMFf4nmlT2bV-hBewY4DHkElH1O9Bl0JDORmI8TJCmMDk-QztwRkxrujc24U9qNK6sEjjpX2BhALplpSkBhiT5GE3GDhHF4GXKyIEIABBN-6E8WZarATCGKL5bCPFcu4dXsvYim6tEDw56xeaI Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Project-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Project-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/57b9766adb34464a8991764937c0f755"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/57b9766adb34464a8991764937c0f755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Tenant: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Tenant-Id: 57b9766adb34464a8991764937c0f755 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TaggedBootDevicesTest-287287032 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-User: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:31 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:46:31 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:46:31 user devstack@n-api.service[72695]: X-User-Id: e6ae1f3ccb2845fb9479448b50a0b919 Apr 12 07:46:31 user devstack@n-api.service[72695]: X-User-Name: tempest-TaggedBootDevicesTest-287287032-project-member Apr 12 07:46:31 user devstack@n-api.service[72695]: method: > Apr 12 07:46:31 user devstack@n-api.service[72695]: exception: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72695]: action_args: {'id': '32a42e95-630c-43a0-9217-2fc72f859f47'} Apr 12 07:46:31 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. Apr 12 07:46:31 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:46:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] Returning 404 to user: Instance 32a42e95-630c-43a0-9217-2fc72f859f47 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:46:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-765adab6-45a1-42d0-aa4f-5cec421f5b76 tempest-TaggedBootDevicesTest-287287032 tempest-TaggedBootDevicesTest-287287032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47" status: 404 len: 111 microversion: 2.32 time: 0.032005 Apr 12 07:46:31 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 142/429] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:46:31 2023] GET /compute/v2.1/servers/32a42e95-630c-43a0-9217-2fc72f859f47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] [instance: d4f9729d-3114-4fc6-a704-02f436c17614] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] HTTP exception thrown: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Request method failure captured: Apr 12 07:46:32 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 HTTP/1.1 Apr 12 07:46:32 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:46:32 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:46:32 user devstack@n-api.service[72697]: Connection: close Apr 12 07:46:32 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:46:32 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:46:32 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:46:32 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:46:32 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAkdQ08DWOsEFYUi7bbLhqgUKHYBmBZ6KaQJbxuIiAx0tooeZprGPYWtDX5FEDUEI7QtFFIerSDuP7J7z-TDBc1P41XPqRxlkpw3VQyvOD1hWrYY2nHfrqDP1veaoQfqdOYjVgoOxu1VzNzYC03NJU36Ok5mGCCswiQ2EyClEN7cAw Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Project-Id: 19a93f4d88764fd49cd8b2eb9ff1cb8f Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Project-Name: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19a93f4d88764fd49cd8b2eb9ff1cb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Tenant: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Tenant-Id: 19a93f4d88764fd49cd8b2eb9ff1cb8f Apr 12 07:46:32 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-407566417 Apr 12 07:46:32 user devstack@n-api.service[72697]: X-User: tempest-VolumesAdminNegativeTest-407566417-project-member Apr 12 07:46:32 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:46:32 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:46:32 user devstack@n-api.service[72697]: X-User-Id: 8de4929e67ed472b90e95066b2c50340 Apr 12 07:46:32 user devstack@n-api.service[72697]: X-User-Name: tempest-VolumesAdminNegativeTest-407566417-project-member Apr 12 07:46:32 user devstack@n-api.service[72697]: method: > Apr 12 07:46:32 user devstack@n-api.service[72697]: exception: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. Apr 12 07:46:32 user devstack@n-api.service[72697]: action_args: {'id': 'd4f9729d-3114-4fc6-a704-02f436c17614'} Apr 12 07:46:32 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. Apr 12 07:46:32 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:46:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Returning 404 to user: Instance d4f9729d-3114-4fc6-a704-02f436c17614 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:46:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6e23c590-31e4-4179-9232-648079e6e51e tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614" status: 404 len: 111 microversion: 2.1 time: 0.028297 Apr 12 07:46:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:32 2023] GET /compute/v2.1/servers/d4f9729d-3114-4fc6-a704-02f436c17614 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:46:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8e082d1a-dd68-41c0-9865-d14c5d59b5a6 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] Calling method '.version_select at 0x7f7c051ce290>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8e082d1a-dd68-41c0-9865-d14c5d59b5a6 tempest-VolumesAdminNegativeTest-407566417 tempest-VolumesAdminNegativeTest-407566417-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-827036857" status: 202 len: 0 microversion: 2.1 time: 0.022209 Apr 12 07:46:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 145/431] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 07:46:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-827036857 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:38 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d599e20f-e9d4-448a-86e9-041fc50ae4a7 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047991 Apr 12 07:46:38 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 143/432] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:46:38 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:46:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f4bb0ad2-6464-44a8-8783-8a67a4ff38e5 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '.version_select at 0x7f7c051588b0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f4bb0ad2-6464-44a8-8783-8a67a4ff38e5 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170" status: 204 len: 0 microversion: 2.1 time: 0.299487 Apr 12 07:46:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 145/433] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:41 2023] DELETE /compute/v2.1/images/605c6427-e907-43e2-b4e9-f596062d8170 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:46:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ca5d8c42-5d9d-41a8-98e0-371afb5d965c tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 204 len: 0 microversion: 2.1 time: 0.173931 Apr 12 07:46:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 146/434] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:46:41 2023] DELETE /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:41 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d67cdd754c467dbe2760ede6f4218d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3578114ca9476ca280abc2e4f83b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b3e13aef-82c1-4ab8-865e-5f442b48bf3b tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 200 len: 1679 microversion: 2.1 time: 0.206239 Apr 12 07:46:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:41 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-unplugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] Creating event network-vif-unplugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:46:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-5c278dd1-281b-417f-b2b6-06a727f6d1f7 req-4c03f572-721f-414f-b188-efe800d6f3ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036678 Apr 12 07:46:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 146/436] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-deleted", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] Creating event network-vif-deleted:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:46:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-249608fe-eeee-4034-9f79-c7880f9f0f55 req-10d90b66-97e4-4924-88a7-625ae4e4f29c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046827 Apr 12 07:46:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:46:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69aeabdc-65e3-4af2-9f8b-3699778c6b89", "name": "network-vif-plugged", "status": "completed", "tag": "0b334cc7-e101-4fdc-9a60-98cf9c11d7ca"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] Creating event network-vif-plugged:0b334cc7-e101-4fdc-9a60-98cf9c11d7ca for instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 on user Apr 12 07:46:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a8e96ec1-26a7-4304-b6ae-0994bd1f9007 req-13c04f69-e5c7-4ab3-a3da-9d480692f07a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Apr 12 07:46:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 145/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:46 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'services' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:46:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-81989c05-8ff9-4df6-906b-b2d0d080c1a9 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/0b3a52e6-052a-43bf-a817-207c82b3dc3b" status: 202 len: 0 microversion: 2.1 time: 0.219911 Apr 12 07:46:46 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 147/439] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:46:46 2023] DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/0b3a52e6-052a-43bf-a817-207c82b3dc3b => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8f722e40-6d53-4d6e-b0c9-b44f130bd6a6 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073650 Apr 12 07:46:46 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 148/440] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:46:46 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:49 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ef0a6bf0-708b-4a69-af1b-37e580109d9f tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1502 microversion: 2.1 time: 0.199900 Apr 12 07:46:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 146/441] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:49 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-341409038", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "b8a83b38-0d35-47f7-9c68-5c0606d94c19"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:50 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] validate_networks() for [('b8a83b38-0d35-47f7-9c68-5c0606d94c19', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for user 2c01e1260cfa45f6b9d225592867f240 and project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:46:51 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:46:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a72552e4-679d-4717-83b5-3a5937c321f7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.639025 Apr 12 07:46:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 148/442] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 07:46:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:46:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-454785c8-0179-479a-83d3-fe570bab81cf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 200 len: 1394 microversion: 2.87 time: 0.083606 Apr 12 07:46:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 149/443] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:46:51 2023] GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:46:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] Creating event network-changed:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 07:46:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7b4ab5aa-880b-45da-b944-0baeb96a873c req-0cc40899-5723-4c85-81af-b985e584a118 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Apr 12 07:46:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 147/444] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "name": "network-vif-plugged", "status": "completed", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:56 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] Creating event network-vif-plugged:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 07:46:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ab709dc8-c260-41f7-adda-534f66a8c9d7 req-076d3fe8-a662-4681-87be-33ab71c27870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040229 Apr 12 07:46:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:46:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-aa43dcac-e43c-42be-ad34-89128e215983 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26480840", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "destination_type": "local"}, {"source_type": "volume", "uuid": "aad0beb6-bb11-4c92-8d5f-ef7b5b66592a", "destination_type": "invalid"}], "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-aa43dcac-e43c-42be-ad34-89128e215983 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:46:57 user devstack@n-api.service[72696]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 07:46:57 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:46:57 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:46:57 user devstack@n-api.service[72696]: Connection: close Apr 12 07:46:57 user devstack@n-api.service[72696]: Content-Length: 492 Apr 12 07:46:57 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:46:57 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:46:57 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:46:57 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:46:57 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:46:57 user devstack@n-api.service[72696]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:46:57 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:46:57 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:46:57 user devstack@n-api.service[72696]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:46:57 user devstack@n-api.service[72696]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:46:57 user devstack@n-api.service[72696]: Apr 12 07:46:57 user devstack@n-api.service[72696]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26480840", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "destination_type": "local"}, {"source_type": "volume", "uuid": "aad0beb6-bb11-4c92-8d5f-ef7b5b66592a", "destination_type": "invalid"}], "networks": [{"uuid": "44ded1bd-af51-4bee-bb78-604e95e530cf"}]}} Apr 12 07:46:57 user devstack@n-api.service[72696]: method: > Apr 12 07:46:57 user devstack@n-api.service[72696]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 07:46:57 user devstack@n-api.service[72696]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-26480840', 'imageRef': '68a0a523-85da-4c40-ac88-5d5f304c0b18', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '68a0a523-85da-4c40-ac88-5d5f304c0b18', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'aad0beb6-bb11-4c92-8d5f-ef7b5b66592a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '44ded1bd-af51-4bee-bb78-604e95e530cf'}]}}} Apr 12 07:46:57 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise error Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 07:46:57 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:46:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-aa43dcac-e43c-42be-ad34-89128e215983 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:46:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-aa43dcac-e43c-42be-ad34-89128e215983 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.015810 Apr 12 07:46:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 150/446] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:46:57 2023] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=17 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=33 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:57 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4436e43a-bc24-4a99-8816-b058e755492a tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1492 microversion: 2.1 time: 0.161490 Apr 12 07:46:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:57 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1492 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:58 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:46:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6b44e463-1d01-4999-b95f-e5ac8427f4a8 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 200 len: 1551 microversion: 2.1 time: 0.157171 Apr 12 07:46:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 150/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:46:58 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "name": "network-vif-plugged", "status": "completed", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:46:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:46:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] Creating event network-vif-plugged:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 07:46:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-074983a2-fd2c-443e-8ff4-2c3b77b95877 req-24352d5e-bd6f-4af4-b377-460b6d764fd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043365 Apr 12 07:46:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 151/449] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e88432ca-8f97-4f1f-83e7-85d098d8ef6b tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048463 Apr 12 07:47:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:47:00 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2aecd0fa-7faf-4bd4-8800-7dc18dbb6863 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1674 microversion: 2.1 time: 0.166612 Apr 12 07:47:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:00 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7bf5a2f6-8f65-43d8-a70f-6b55c79ea984 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1674 microversion: 2.1 time: 0.177619 Apr 12 07:47:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:00 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:00 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b5d10281-9b99-4aef-acbf-e49904997c4a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1674 microversion: 2.1 time: 0.224422 Apr 12 07:47:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 150/453] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:00 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Going to try to start instance {{(pid=72697) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 07:47:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d8acfcac-dab9-4f25-9206-c036e06b994f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.079991 Apr 12 07:47:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 152/454] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:47:04 2023] POST /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:05 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5f3ac85b-b687-4b17-99df-bbbf93f8eb38 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1651 microversion: 2.1 time: 0.194717 Apr 12 07:47:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 153/455] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:04 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1651 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:07 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:47:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fe053f14-6545-4ac9-aec0-35436bacecb5 req-c9eb738f-b650-415b-90b0-c5ab8175514d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040626 Apr 12 07:47:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 151/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:47:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-1b56ace4-4541-4f5f-bdc4-f8f4c0aae7ad req-353e4469-ce1e-4f65-95b8-a8b10cc9d74b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Apr 12 07:47:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 153/457] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=5 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=14 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] [instance: 69aeabdc-65e3-4af2-9f8b-3699778c6b89] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] HTTP exception thrown: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Request method failure captured: Apr 12 07:47:31 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 HTTP/1.1 Apr 12 07:47:31 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:47:31 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:47:31 user devstack@n-api.service[72696]: Connection: close Apr 12 07:47:31 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:47:31 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:47:31 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:47:31 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:47:31 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAn7T8feUya-a4JAz2X87vCHo5LQKghsomaKIHN7k6X_Px4Fdigae8UnvY3PCD331sgeEAPXqx5kB9bdb8S4TiQFy1xSeOLKJIBRUkEVm5n1D9uWB72WYIm4-5c5RcGXIuf0cvB0Uol9rFSzN-fqKxb4KahiIbTK0NnPhPr8dUzK10 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Project-Id: bc3578114ca9476ca280abc2e4f83b11 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerStableDeviceRescueTest-473420304 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc3578114ca9476ca280abc2e4f83b11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bc3578114ca9476ca280abc2e4f83b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bc3578114ca9476ca280abc2e4f83b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerStableDeviceRescueTest-473420304 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Tenant-Id: bc3578114ca9476ca280abc2e4f83b11 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-473420304 Apr 12 07:47:31 user devstack@n-api.service[72696]: X-User: tempest-ServerStableDeviceRescueTest-473420304-project-member Apr 12 07:47:31 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:47:31 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:47:31 user devstack@n-api.service[72696]: X-User-Id: b3d67cdd754c467dbe2760ede6f4218d Apr 12 07:47:31 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerStableDeviceRescueTest-473420304-project-member Apr 12 07:47:31 user devstack@n-api.service[72696]: method: > Apr 12 07:47:31 user devstack@n-api.service[72696]: exception: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. Apr 12 07:47:31 user devstack@n-api.service[72696]: action_args: {'id': '69aeabdc-65e3-4af2-9f8b-3699778c6b89'} Apr 12 07:47:31 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. Apr 12 07:47:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:47:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Returning 404 to user: Instance 69aeabdc-65e3-4af2-9f8b-3699778c6b89 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:47:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f16c4cee-0aaf-4c32-9446-9f40d8a03342 tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89" status: 404 len: 111 microversion: 2.1 time: 0.037375 Apr 12 07:47:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 154/458] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:31 2023] GET /compute/v2.1/servers/69aeabdc-65e3-4af2-9f8b-3699778c6b89 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:47:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=7 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=19 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-2697a730-f86b-486a-988e-eb6eeae54c8f tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] Calling method '.version_select at 0x7f7c053e2e60>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-2697a730-f86b-486a-988e-eb6eeae54c8f tempest-ServerStableDeviceRescueTest-473420304 tempest-ServerStableDeviceRescueTest-473420304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777808843" status: 202 len: 0 microversion: 2.1 time: 0.035606 Apr 12 07:47:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 152/459] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 07:47:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777808843 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=9 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-989365315", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "a5752d9a-79d5-4f8c-877b-1aeb615c2285"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] validate_networks() for [('a5752d9a-79d5-4f8c-877b-1aeb615c2285', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting quotas for project 468e9932c7634b0d8c3257ee14a66959. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting quotas for user 76d4eef76f634fb39c1f0895abfbd17d and project 468e9932c7634b0d8c3257ee14a66959. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:47:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:47:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0884d8d1-8e60-4099-bedc-42a3f57d594f tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.493117 Apr 12 07:47:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 154/460] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:47:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:47:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a1e3b796-694d-4892-944e-8bccd93a97ad tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:32 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a1e3b796-694d-4892-944e-8bccd93a97ad tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:32 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-a1e3b796-694d-4892-944e-8bccd93a97ad tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-a1e3b796-694d-4892-944e-8bccd93a97ad tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce" status: 200 len: 1212 microversion: 2.1 time: 0.073855 Apr 12 07:47:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 155/461] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:32 2023] GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] Creating event network-changed:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:47:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-81f83ceb-509b-4f95-96e9-ac03fcbb1d00 req-148003ae-cd5a-4739-8b24-a1342a060b66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039632 Apr 12 07:47:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 153/462] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:36 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-12d15b1c-67a5-4bcc-b24d-7ce6f30b6385 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046849 Apr 12 07:47:36 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 155/463] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:47:36 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:47:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "name": "network-vif-plugged", "status": "completed", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] Creating event network-vif-plugged:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:47:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d7957325-cf60-4dd1-978c-ea26e0298431 req-e8baa1fd-1b2c-4618-ac28-701406b765de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Apr 12 07:47:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:39 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "name": "network-vif-plugged", "status": "completed", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] Creating event network-vif-plugged:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:47:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-f4f87284-689a-47d8-acca-4518b386ee1d req-dd053311-816b-4deb-843d-803bff17abb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029736 Apr 12 07:47:39 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 154/465] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "077784be-9724-4872-a5c7-11f2fd1ebf64"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-dc1bf7e0-4f13-4343-9a6c-9833be1d773c tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308320 Apr 12 07:47:40 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 156/466] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:47:40 2023] POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:41 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8964a20a-c9fd-40e8-b6a3-34cce201a15c tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 200 len: 1691 microversion: 2.87 time: 0.303472 Apr 12 07:47:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 157/467] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:47:41 2023] GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:48 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'services' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:47:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3dd41693-856d-44bc-8942-6c0dfbef1690 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/077784be-9724-4872-a5c7-11f2fd1ebf64" status: 202 len: 0 microversion: 2.1 time: 0.238880 Apr 12 07:47:48 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 155/468] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:47:48 2023] DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/077784be-9724-4872-a5c7-11f2fd1ebf64 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-5df12350-ed4a-4d1b-b41c-76dd94363354 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Apr 12 07:47:48 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 157/469] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:47:48 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b1fa2ca8-1175-4c17-85f2-cf7723db0100 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: .version_select at 0x7f7c051ceb00>, body: {"keypair": {"name": "tempest-keypair-44620121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqGGXXPtvQkc4Q+1b1tPxLW6NgPiaphqfUdgbK5JXJXP525ewACIqwvdzXe6oF4g+7xY5gbo/sFkRUpVm0ItlkNFkuEY1IfoP9Pq3jpaEgq3F2toZknWB7N0LTVnEYTQg=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:51 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b1fa2ca8-1175-4c17-85f2-cf7723db0100 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:47:51 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b1fa2ca8-1175-4c17-85f2-cf7723db0100 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for user 86009132a34b466399da1701f47316d9 and project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:47:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b1fa2ca8-1175-4c17-85f2-cf7723db0100 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.065939 Apr 12 07:47:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 158/470] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:47:51 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1976346504", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0ce68a1e-e059-45d3-85f8-0efaeaf88149"}], "security_groups": [{"name": "tempest-securitygroup--19289109"}], "key_name": "tempest-keypair-44620121", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] validate_networks() for [('0ce68a1e-e059-45d3-85f8-0efaeaf88149', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Getting quotas for user 86009132a34b466399da1701f47316d9 and project 2b1c96acdf1f46f4b660de199d2b852b. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:47:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:47:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-22fa4774-6e2d-49df-a9be-9fbf96e03ffe tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727697 Apr 12 07:47:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 156/471] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:47:53 2023] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:47:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c1d918aa-1bc3-4994-92cd-b18b1dc839d4 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:53 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c1d918aa-1bc3-4994-92cd-b18b1dc839d4 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:53 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-c1d918aa-1bc3-4994-92cd-b18b1dc839d4 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c1d918aa-1bc3-4994-92cd-b18b1dc839d4 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1238 microversion: 2.1 time: 0.062587 Apr 12 07:47:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 158/472] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:53 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=10 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:55 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2857e150-9e88-49b0-9a30-2b0a4ee2f4f2 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1655 microversion: 2.1 time: 0.162068 Apr 12 07:47:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:55 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] Creating event network-changed:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:47:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-08574472-532a-4b1a-8192-6e74daf2ae71 req-606e1563-f0de-4c53-819c-6416fb96fcf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040274 Apr 12 07:47:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 157/474] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:58 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a22db937-333a-401b-9b63-87cecda020a3 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 200 len: 1551 microversion: 2.1 time: 0.175502 Apr 12 07:47:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 159/475] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:58 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 1551 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:47:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:47:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:47:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-da568317-bc68-4f7e-9d79-3a1396c81f63 req-41d6d808-ca47-42cb-b3b4-2060833bcdee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029698 Apr 12 07:47:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 158/476] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:47:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-336f546d-2b36-4d41-afe3-eb6dac621693 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 204 len: 0 microversion: 2.1 time: 0.248629 Apr 12 07:47:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 160/477] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:47:58 2023] DELETE /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:47:59 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:47:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-76d7b81f-039b-43d8-a1a8-f65bbe9b8d75 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 200 len: 1557 microversion: 2.1 time: 0.200219 Apr 12 07:47:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 160/478] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:47:59 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 1557 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}, {"server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}, {"server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "name": "network-vif-plugged", "status": "completed", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}, {"server_uuid": "8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5", "name": "network-vif-deleted", "tag": "4b7609bc-36a3-40bc-a911-644f8b0d1766"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:48:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Creating event network-vif-unplugged:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:48:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Creating event network-vif-plugged:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:48:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] Creating event network-vif-deleted:4b7609bc-36a3-40bc-a911-644f8b0d1766 for instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 on user Apr 12 07:48:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-87528c8e-2438-4a3f-913a-91821ffea3e2 req-9af181c7-d080-4121-a37c-8e723e040245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.039110 Apr 12 07:48:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 159/479] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] HTTP exception thrown: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:48:02 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 HTTP/1.1 Apr 12 07:48:02 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:48:02 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:48:02 user devstack@n-api.service[72696]: Connection: close Apr 12 07:48:02 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:48:02 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:48:02 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:48:02 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:48:02 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:02 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72696]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:02 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:48:02 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:48:02 user devstack@n-api.service[72696]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:48:02 user devstack@n-api.service[72696]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:02 user devstack@n-api.service[72696]: method: > Apr 12 07:48:02 user devstack@n-api.service[72696]: exception: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72696]: action_args: {'id': 'b71c5ba4-aeff-454c-a89c-0cef7ab13806'} Apr 12 07:48:02 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 404 to user: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:48:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d8ed1ec2-06c0-46f6-8929-a0ea4cca6492 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 404 len: 111 microversion: 2.1 time: 0.059098 Apr 12 07:48:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 161/480] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:48:02 2023] DELETE /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: b71c5ba4-aeff-454c-a89c-0cef7ab13806] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] HTTP exception thrown: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:48:02 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 HTTP/1.1 Apr 12 07:48:02 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:48:02 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:48:02 user devstack@n-api.service[72695]: Connection: close Apr 12 07:48:02 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:48:02 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:48:02 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:48:02 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:48:02 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:02 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:02 user devstack@n-api.service[72695]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:02 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:48:02 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:48:02 user devstack@n-api.service[72695]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:48:02 user devstack@n-api.service[72695]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:02 user devstack@n-api.service[72695]: method: > Apr 12 07:48:02 user devstack@n-api.service[72695]: exception: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72695]: action_args: {'id': 'b71c5ba4-aeff-454c-a89c-0cef7ab13806'} Apr 12 07:48:02 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. Apr 12 07:48:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 404 to user: Instance b71c5ba4-aeff-454c-a89c-0cef7ab13806 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:48:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-8070d318-3ae2-4eb5-b362-a560db47bc12 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806" status: 404 len: 111 microversion: 2.1 time: 0.058904 Apr 12 07:48:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 160/481] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:02 2023] GET /compute/v2.1/servers/b71c5ba4-aeff-454c-a89c-0cef7ab13806 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:48:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2a65f544-1b1d-4cd9-9e2b-676e1e7ce603 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 204 len: 0 microversion: 2.1 time: 0.146509 Apr 12 07:48:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 162/482] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:48:02 2023] DELETE /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:48:02 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4ecd7e52-f83a-4157-968e-7269863f696a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1674 microversion: 2.1 time: 0.241059 Apr 12 07:48:02 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 161/483] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:02 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "894167f3-141a-4eb7-80a6-60d5af7aada7"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:02 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b61df1643964059b70eba466af4b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1ea22b656f42ab9e8d117b0ff11b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-39257137-d59f-4d99-9144-3bc0c48f3a6b tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 200 len: 1498 microversion: 2.1 time: 0.386870 Apr 12 07:48:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 161/484] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:02 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 1498 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7fc22f70-9874-447f-ac46-07ccbf7a407a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473282 Apr 12 07:48:03 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 163/485] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:48:02 2023] POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "name": "network-vif-unplugged", "status": "completed", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] Creating event network-vif-unplugged:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:48:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a9e2d7da-7e02-42c4-ab09-070fea3ac8b1 req-7290dc74-e6ff-46aa-98f3-7519c1d19fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065434 Apr 12 07:48:03 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 162/486] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "name": "network-vif-plugged", "status": "completed", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}, {"server_uuid": "e21b1323-aafd-4989-92c0-3ba5b45ba2bc", "name": "network-vif-deleted", "tag": "d739ef84-c04b-4cbc-b836-4bf88483d1a4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Creating event network-vif-plugged:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:48:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] Creating event network-vif-deleted:d739ef84-c04b-4cbc-b836-4bf88483d1a4 for instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc on user Apr 12 07:48:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-77b87272-a647-46d5-bc69-482358a5e9a1 req-f3e16053-5c70-4fb5-984b-e9484a86f084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041749 Apr 12 07:48:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 162/487] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Old instance type m1.nano, new instance type m1.micro {{(pid=72696) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:48:10 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:48:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ca6f2324-e03c-4a9a-9623-d76d57cdc62e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action" status: 202 len: 0 microversion: 2.1 time: 0.261548 Apr 12 07:48:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 164/488] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:48:10 2023] POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:11 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6354d888-1d9d-48c3-96a5-1e75a60216b3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1729 microversion: 2.1 time: 0.141811 Apr 12 07:48:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 163/489] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:11 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1729 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-unplugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Creating event network-vif-unplugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:48:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72695) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:48:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-707a7eb1-2407-48c0-9836-25f8e24614d6 req-4d18bc46-cbe0-46cd-b76d-67772a9cd29b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049236 Apr 12 07:48:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:48:16 user devstack@n-api.service[72696]: DEBUG nova.compute.api [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72696) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:48:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f51294e0-3485-404f-b701-5ca9d0c9132f req-a14688fd-481c-437b-9449-e3b5471520f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057767 Apr 12 07:48:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 165/491] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=5 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=13 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:22 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-ff42fca0-845a-4f20-a105-421892a38105 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce" status: 200 len: 1496 microversion: 2.1 time: 0.165969 Apr 12 07:48:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 164/492] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:22 2023] GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=7 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=13 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:48:27 user devstack@n-api.service[72695]: DEBUG nova.compute.api [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72695) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:48:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-88f2c34b-15ed-4284-8a6a-03cd2f516522 req-08f908ca-547d-4e5e-8282-31706f01b9fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045892 Apr 12 07:48:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:48:29 user devstack@n-api.service[72696]: DEBUG nova.compute.api [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72696) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:48:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-570c14bb-43fd-4b95-b68e-2338814e6fcb req-5b0ff516-6628-402d-8874-35d921d11343 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062145 Apr 12 07:48:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 166/494] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c10a330a-c884-412b-8a90-edd0b67c4a04 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045710 Apr 12 07:48:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 165/495] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:48:38 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-35389323", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] validate_networks() for None {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Getting quotas for project 853e85be61864e66b0b8e8be4e3059fa. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Getting quotas for user 66018ab9b9c54fc593b4f872f6ef4c9a and project 853e85be61864e66b0b8e8be4e3059fa. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:48:40 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:48:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-228d6ad4-e404-4fa6-8154-49874b8e4c14 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.440912 Apr 12 07:48:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 165/496] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:48:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:48:40 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:40 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:40 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9c0ed1fc-5667-40f7-8908-f4d5427b222d tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:40 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-9c0ed1fc-5667-40f7-8908-f4d5427b222d tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:41 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-9c0ed1fc-5667-40f7-8908-f4d5427b222d tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66018ab9b9c54fc593b4f872f6ef4c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853e85be61864e66b0b8e8be4e3059fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-9c0ed1fc-5667-40f7-8908-f4d5427b222d tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" status: 200 len: 1207 microversion: 2.1 time: 0.076163 Apr 12 07:48:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 167/497] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:40 2023] GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => generated 1207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78addffa-1acb-411d-9bc2-6e61bac1e13b"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1265573444"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-75dfd71e-3b6a-4706-adcd-9492a301c832 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452131 Apr 12 07:48:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 166/498] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:48:41 2023] POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d81443c3-010e-4701-9581-0802d324a1f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d/action" status: 202 len: 52 microversion: 2.87 time: 0.889225 Apr 12 07:48:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 166/499] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 07:48:41 2023] POST /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d/action => generated 52 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 07:48:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] Creating event network-changed:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:48:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-43e9465a-be7d-4c44-aa56-03d25ec27fa0 req-f96d9a65-4aa7-4e75-b070-2f31505083fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035775 Apr 12 07:48:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 168/500] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1c5848f4-5b20-4cbf-bb0e-9e251644cf34 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1549 microversion: 2.1 time: 0.161356 Apr 12 07:48:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 167/501] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:43 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "name": "network-vif-plugged", "status": "completed", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] Creating event network-vif-plugged:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:48:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-9b0259c2-c0cf-4f0e-a52e-f9bd3eb303de req-879a1b28-329b-4b19-8c46-4a8c8e2705d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Apr 12 07:48:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 167/502] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "name": "network-vif-plugged", "status": "completed", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] Creating event network-vif-plugged:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:48:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-56e81d74-b425-40d9-8164-5f7432f1e43e req-c9180f90-2942-4dfb-850e-585b4056b0ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050493 Apr 12 07:48:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 169/503] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:49 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:49 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:49 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a6b00d88-67be-4848-8542-731e703a34f4 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 200 len: 1691 microversion: 2.87 time: 0.207952 Apr 12 07:48:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 168/504] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:48:48 2023] GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 1691 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:48:49 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 HTTP/1.1 Apr 12 07:48:49 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:48:49 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:48:49 user devstack@n-api.service[72695]: Connection: close Apr 12 07:48:49 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:48:49 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:48:49 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:48:49 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:48:49 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:48:49 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:48:49 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:48:49 user devstack@n-api.service[72695]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:48:49 user devstack@n-api.service[72695]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:48:49 user devstack@n-api.service[72695]: method: > Apr 12 07:48:49 user devstack@n-api.service[72695]: exception: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:48:49 user devstack@n-api.service[72695]: action_args: {'id': '8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5'} Apr 12 07:48:49 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:48:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:48:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-66eae302-8d16-41a6-8df5-036b88780c2d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 404 len: 111 microversion: 2.1 time: 0.029126 Apr 12 07:48:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 168/505] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:49 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:49 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'services' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:48:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-edabcfa7-6d85-4016-bc11-42bae6e203cd tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/78addffa-1acb-411d-9bc2-6e61bac1e13b" status: 202 len: 0 microversion: 2.1 time: 0.207816 Apr 12 07:48:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 170/506] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:48:49 2023] DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/78addffa-1acb-411d-9bc2-6e61bac1e13b => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6498fd4a-17cb-419d-8802-9d199a45cb33 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057733 Apr 12 07:48:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 169/507] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:48:50 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:48:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e81d8c25-e99c-40a7-b015-ebbe96e0ad29 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 204 len: 0 microversion: 2.1 time: 0.128824 Apr 12 07:48:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 169/508] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:48:51 2023] DELETE /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4c14d9ca-fef7-4345-a968-233de1c40d43 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 200 len: 1399 microversion: 2.1 time: 0.245740 Apr 12 07:48:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 171/509] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:51 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 1399 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "name": "network-vif-unplugged", "status": "completed", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] Creating event network-vif-unplugged:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:48:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f0386154-d29b-47f4-9d53-33b754154f7d req-5ea0591e-5d79-4dbd-a627-576228e7593c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039472 Apr 12 07:48:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 170/510] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] [instance: e21b1323-aafd-4989-92c0-3ba5b45ba2bc] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] HTTP exception thrown: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Request method failure captured: Apr 12 07:48:53 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc HTTP/1.1 Apr 12 07:48:53 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:48:53 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:48:53 user devstack@n-api.service[72695]: Connection: close Apr 12 07:48:53 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:48:53 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:48:53 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:48:53 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:48:53 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAmQ2uEEaksz9rWRiLhtlNibTPoPg2XpE32poSe15xv1l2ojYNxm7FrnInk-bILNtnOUgRqmk3HWtBueH1MhMpm2wBPHh75IC9P4Z8XNXSbYckQ1skNzyUJz7p7DEh4ODobF-TD06qMgkf-SoEXRZMwSN18B0AiC1ub_T0IkFRpjQM Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Project-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1ea22b656f42ab9e8d117b0ff11b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Tenant: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Tenant-Id: 2b1ea22b656f42ab9e8d117b0ff11b3a Apr 12 07:48:53 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1126238824 Apr 12 07:48:53 user devstack@n-api.service[72695]: X-User: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:53 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:48:53 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:48:53 user devstack@n-api.service[72695]: X-User-Id: 4b61df1643964059b70eba466af4b6db Apr 12 07:48:53 user devstack@n-api.service[72695]: X-User-Name: tempest-ServersNegativeTestJSON-1126238824-project-member Apr 12 07:48:53 user devstack@n-api.service[72695]: method: > Apr 12 07:48:53 user devstack@n-api.service[72695]: exception: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. Apr 12 07:48:53 user devstack@n-api.service[72695]: action_args: {'id': 'e21b1323-aafd-4989-92c0-3ba5b45ba2bc'} Apr 12 07:48:53 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. Apr 12 07:48:53 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:48:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] Returning 404 to user: Instance e21b1323-aafd-4989-92c0-3ba5b45ba2bc could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:48:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-061003ce-41d3-4dcb-92e3-7df6046bc338 tempest-ServersNegativeTestJSON-1126238824 tempest-ServersNegativeTestJSON-1126238824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc" status: 404 len: 111 microversion: 2.1 time: 0.029568 Apr 12 07:48:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 170/511] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:53 2023] GET /compute/v2.1/servers/e21b1323-aafd-4989-92c0-3ba5b45ba2bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:48:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "name": "network-vif-deleted", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] Creating event network-vif-deleted:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:48:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-fa48033e-027e-492b-a9c8-9bbfa5deb44e req-97656959-1a84-46c7-b956-23323677c359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Apr 12 07:48:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 172/512] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487f2b38-0f8d-40c1-9c10-32caf60a61a2", "name": "network-vif-plugged", "status": "completed", "tag": "93af7856-3e09-423a-a240-2e00ddcf6ce0"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] Creating event network-vif-plugged:93af7856-3e09-423a-a240-2e00ddcf6ce0 for instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 on user Apr 12 07:48:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-659a5b05-ade4-4d8c-a5ff-c2aa3483c679 req-c10423a2-ce55-418e-8994-35682be938bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Apr 12 07:48:54 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 171/513] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1e904ae3-b25e-4f9a-8762-dbc6cacaec33 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049110 Apr 12 07:48:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 171/514] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:48:55 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:55 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:48:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-36fbea3b-1350-4717-9f64-1eb413c6a76a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 204 len: 0 microversion: 2.1 time: 0.130558 Apr 12 07:48:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 173/515] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:48:55 2023] DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:56 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:48:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-3d6d3427-2b9e-4947-beed-fd7f08dcd290 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 200 len: 1661 microversion: 2.1 time: 0.229981 Apr 12 07:48:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 172/516] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:48:55 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 1661 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:48:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] Creating event network-vif-unplugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:48:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7ad93616-8eab-406d-8f5b-b1833d5645ec req-981d9eff-462e-453c-b8f4-e41c38125c8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080464 Apr 12 07:48:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 172/517] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-deleted", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] Creating event network-vif-deleted:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:48:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d515c569-7851-4e1f-abe4-1218121a27f7 req-6fe10d55-a1ce-4d31-87ee-3e83f6ee02ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Apr 12 07:48:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 174/518] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:48:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ca8ec-41b5-4b60-882f-d74d906fb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "40ca8897-7180-4ef1-91f2-29b18afbcc25"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:48:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:48:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:48:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:48:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] Creating event network-vif-plugged:40ca8897-7180-4ef1-91f2-29b18afbcc25 for instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 on user Apr 12 07:48:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6b6e35ea-6be5-4005-bf51-82c9d6b436d1 req-8af13218-7477-44fb-9098-9e344638adee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029010 Apr 12 07:48:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 173/519] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:01 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fdc6026a-0578-41ed-8e8b-c3c0babcbd2d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1728 microversion: 2.1 time: 0.220110 Apr 12 07:49:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 173/520] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:01 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e8936ee9-f99b-45b0-82ff-556430ebc9a0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: .version_select at 0x7f7c0509e4d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-788402656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLzY56nfW8OEMJkjHjkdDbXLb566pyf02ysEp6n7PHrmNajDgG8RhaQTvsRkpar47XK1mvJ5wdw48Fv6Rwy3vXxcwxqXACW2/ANwVg0vUhn+/FcIk+FXGAWCEbKT4ytQ=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:22 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-e8936ee9-f99b-45b0-82ff-556430ebc9a0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:22 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-e8936ee9-f99b-45b0-82ff-556430ebc9a0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for user 630f8381d3534fd3a1978fc0a931e8c0 and project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e8936ee9-f99b-45b0-82ff-556430ebc9a0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.071532 Apr 12 07:49:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 175/521] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:49:22 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-381898933", "imageRef": "47938fc9-ecf8-4c1a-8f19-67593f191ec6", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-788402656", "networks": [{"uuid": "8d582cc3-519c-40ba-ae13-e3410dd86c82"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=20 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:22 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] validate_networks() for [('8d582cc3-519c-40ba-ae13-e3410dd86c82', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eca1c24-192a-426f-ba99-a899f2e68f90", "device": "/dev/vdb"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for user 630f8381d3534fd3a1978fc0a931e8c0 and project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:49:23 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='47938fc9-ecf8-4c1a-8f19-67593f191ec6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:49:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d442fdfa-efee-478e-9758-7afe4e03ea72 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.673300 Apr 12 07:49:23 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 174/522] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:49:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:49:23 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-be7b59b0-1ee0-4bbb-bac5-a9abf4f5077a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:23 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-be7b59b0-1ee0-4bbb-bac5-a9abf4f5077a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4bf81b3d-fcdb-4f88-99c0-b00faeb5f163 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407988 Apr 12 07:49:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 174/523] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:49:22 2023] POST /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-be7b59b0-1ee0-4bbb-bac5-a9abf4f5077a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-be7b59b0-1ee0-4bbb-bac5-a9abf4f5077a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1251 microversion: 2.1 time: 0.184025 Apr 12 07:49:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 176/524] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:23 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1251 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] Creating event network-changed:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:49:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-b72ca348-9eb3-4239-8871-de88bc7825d6 req-8eb91434-eb0d-483c-b3d9-8accc79914c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038335 Apr 12 07:49:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 175/525] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:49:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-df81619c-4566-4342-8bda-a2ac220077a1 req-f9adb0ab-db69-49ec-a0aa-29bc6929f20a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Apr 12 07:49:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 175/526] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:31 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66018ab9b9c54fc593b4f872f6ef4c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853e85be61864e66b0b8e8be4e3059fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d502abdd-4a2b-476c-b44a-5ca26a7988e1 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" status: 200 len: 1453 microversion: 2.1 time: 0.156877 Apr 12 07:49:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 177/527] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:31 2023] GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:49:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-b3c1b4e0-0f1e-4ff1-b0fc-a8835f16f8ac req-5a2650db-e0dd-45db-b584-f263e5f9259b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031403 Apr 12 07:49:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 176/528] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-09ed9975-e7ff-42a3-8e29-99418967ada2 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155764 Apr 12 07:49:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 176/529] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:49:40 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:49:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:49:42 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 HTTP/1.1 Apr 12 07:49:42 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:49:42 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:49:42 user devstack@n-api.service[72696]: Connection: close Apr 12 07:49:42 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:49:42 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:49:42 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:49:42 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:49:42 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72696]: method: > Apr 12 07:49:42 user devstack@n-api.service[72696]: exception: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: action_args: {'id': '487f2b38-0f8d-40c1-9c10-32caf60a61a2'} Apr 12 07:49:42 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-9c2565ca-af4c-4db3-9bcd-81829aef457d tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 404 len: 111 microversion: 2.1 time: 0.055786 Apr 12 07:49:42 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 178/530] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:41 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:49:42 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 HTTP/1.1 Apr 12 07:49:42 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:49:42 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:49:42 user devstack@n-api.service[72697]: Connection: close Apr 12 07:49:42 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:49:42 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:49:42 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:49:42 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:49:42 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72697]: method: > Apr 12 07:49:42 user devstack@n-api.service[72697]: exception: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: action_args: {'id': '8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5'} Apr 12 07:49:42 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2cbf2628-b9b7-42da-98f8-92804a123edd tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 404 len: 111 microversion: 2.1 time: 0.034955 Apr 12 07:49:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 177/531] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:49:42 2023] DELETE /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:49:42 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 HTTP/1.1 Apr 12 07:49:42 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:49:42 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:49:42 user devstack@n-api.service[72695]: Connection: close Apr 12 07:49:42 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:49:42 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:49:42 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:49:42 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:49:42 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72695]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:49:42 user devstack@n-api.service[72695]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72695]: method: > Apr 12 07:49:42 user devstack@n-api.service[72695]: exception: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72695]: action_args: {'id': '8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5'} Apr 12 07:49:42 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-22cfe5f8-f833-4ec6-8621-839a961114de tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5" status: 404 len: 111 microversion: 2.1 time: 0.047292 Apr 12 07:49:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:42 2023] GET /compute/v2.1/servers/8dd89aa0-df1e-4e74-bf0e-c66b2a01f1c5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:49:42 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 HTTP/1.1 Apr 12 07:49:42 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:49:42 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:49:42 user devstack@n-api.service[72696]: Connection: close Apr 12 07:49:42 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:49:42 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:49:42 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:49:42 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:49:42 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:49:42 user devstack@n-api.service[72696]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72696]: method: > Apr 12 07:49:42 user devstack@n-api.service[72696]: exception: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: action_args: {'id': '487f2b38-0f8d-40c1-9c10-32caf60a61a2'} Apr 12 07:49:42 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-849829d1-dce1-4047-a22b-4ec386ebc8e7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 404 len: 111 microversion: 2.1 time: 0.032931 Apr 12 07:49:42 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 179/533] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:49:42 2023] DELETE /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 487f2b38-0f8d-40c1-9c10-32caf60a61a2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:49:42 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 HTTP/1.1 Apr 12 07:49:42 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:49:42 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:49:42 user devstack@n-api.service[72697]: Connection: close Apr 12 07:49:42 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:49:42 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:49:42 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:49:42 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:49:42 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:49:42 user devstack@n-api.service[72697]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:49:42 user devstack@n-api.service[72697]: method: > Apr 12 07:49:42 user devstack@n-api.service[72697]: exception: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: action_args: {'id': '487f2b38-0f8d-40c1-9c10-32caf60a61a2'} Apr 12 07:49:42 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. Apr 12 07:49:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 487f2b38-0f8d-40c1-9c10-32caf60a61a2 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1967933f-caaa-41fb-a425-054c16c1cc0f tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2" status: 404 len: 111 microversion: 2.1 time: 0.062120 Apr 12 07:49:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 178/534] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:42 2023] GET /compute/v2.1/servers/487f2b38-0f8d-40c1-9c10-32caf60a61a2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c795a10c-4854-41c4-a96a-dbc581ba7595 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: .version_select at 0x7f7c0516d510>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1580615295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxkEWQaOKe1IrmUJBzq2O9ULvt4LhuLy6EpwjVE0RZnNuiBSZqvSrJsiUx40M8EPICGn1V8p1qYFKko9wZ9H5mIt9jQsJHy6D9nY+TGQ/jYhnwycWSv/R0a5DukQ3nrUQ=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-c795a10c-4854-41c4-a96a-dbc581ba7595 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:42 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-c795a10c-4854-41c4-a96a-dbc581ba7595 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c795a10c-4854-41c4-a96a-dbc581ba7595 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058553 Apr 12 07:49:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 178/535] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:49:42 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3538e8ac-5519-4d52-92fc-1e55d8abdefe"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-18583685-a2cc-4527-9f70-408090d7f2af tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303108 Apr 12 07:49:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 180/536] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:49:42 2023] POST /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-590fd682-0f6e-4d20-9b05-6361daf363ac tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.135259 Apr 12 07:49:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 179/537] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:49:44 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-interface => generated 282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] Creating event network-changed:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:49:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-146d1347-4004-46ee-bacc-62d97ddc8df2 req-6fd8273d-afa5-447e-a009-d363f048e192 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037241 Apr 12 07:49:45 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 179/538] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "845065d9-ece0-4d59-b500-cb1c3f40197f"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:45 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'services' on Instance uuid 00258d37-14c7-4657-b9c4-c636c93811ce {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:49:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-987689af-f56b-4438-9b19-c7586eaf7772 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce/os-volume_attachments/6eca1c24-192a-426f-ba99-a899f2e68f90" status: 202 len: 0 microversion: 2.1 time: 0.209807 Apr 12 07:49:46 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 180/539] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:49:45 2023] DELETE /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce/os-volume_attachments/6eca1c24-192a-426f-ba99-a899f2e68f90 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:49:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5e6123b9-f882-4c0b-a182-169ddc64d591 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358179 Apr 12 07:49:46 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 181/540] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:49:45 2023] POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b62a01ae-14ba-40d3-80d9-632151e126df tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce" status: 204 len: 0 microversion: 2.1 time: 0.139609 Apr 12 07:49:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 180/541] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:49:46 2023] DELETE /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:49:46 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 HTTP/1.1 Apr 12 07:49:46 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:49:46 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:49:46 user devstack@n-api.service[72697]: Connection: close Apr 12 07:49:46 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:49:46 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:49:46 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:49:46 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:49:46 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:49:46 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:49:46 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:49:46 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:49:46 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:49:46 user devstack@n-api.service[72697]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:49:46 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:49:46 user devstack@n-api.service[72697]: method: > Apr 12 07:49:46 user devstack@n-api.service[72697]: exception: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:49:46 user devstack@n-api.service[72697]: action_args: {'id': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'} Apr 12 07:49:46 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:49:46 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:49:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:49:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f876d5ff-1b93-4e22-97e6-12d4b3a4e7d3 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 404 len: 111 microversion: 2.1 time: 0.036996 Apr 12 07:49:46 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 181/542] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:46 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:49:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-dc3a43c1-388c-4f09-92e3-0a0c56e8caa5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '.version_select at 0x7f7c0516fd90>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-dc3a43c1-388c-4f09-92e3-0a0c56e8caa5 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283331574" status: 202 len: 0 microversion: 2.1 time: 0.023684 Apr 12 07:49:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 181/543] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 07:49:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283331574 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:49:46 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-6c84fe42-9884-4384-9dbd-eef3f3134d4a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce" status: 200 len: 1548 microversion: 2.1 time: 0.187878 Apr 12 07:49:46 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 182/544] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:46 2023] GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:47 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e988facc-3948-43d8-9d2b-65e0d4373d2f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: .version_select at 0x7f7c05158e50>, body: {"keypair": {"name": "tempest-keypair-10133080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCedAa62t7wTvsMMaws5FD+HUmLenb3mQ4AwNRmz+5NlHwSxx+o2cxbVwQovpHZ/OrawGaz4PYDTmPhVUwUu7H+S0t7XDeKFrnIndqQ1jSYYzsPhBvnJ2fPVpdw6VG97eQ=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:47 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-e988facc-3948-43d8-9d2b-65e0d4373d2f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for project f7915d29fb124c838093eba0ee6cb69c. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:47 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-e988facc-3948-43d8-9d2b-65e0d4373d2f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for user a555fa5e6680420e80fcc925a7540806 and project f7915d29fb124c838093eba0ee6cb69c. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e988facc-3948-43d8-9d2b-65e0d4373d2f tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056010 Apr 12 07:49:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 182/545] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:49:47 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "name": "network-vif-unplugged", "status": "completed", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1609383368", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1580615295", "security_groups": [{"name": "tempest-secgroup-smoke-278447882"}], "block_device_mapping_v2": [{"uuid": "fe954cd5-982e-420d-b3e2-6da8bff98d9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] Creating event network-vif-unplugged:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:49:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f6f8eeec-f311-4f8f-8c2f-caa114147b75 req-ba36385f-1754-4943-95d1-f9cd87a52be5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033067 Apr 12 07:49:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 183/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:48 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe954cd5-982e-420d-b3e2-6da8bff98d9f',volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:49:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-895be496-acea-4626-abb9-af4bc94eb298 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.024969 Apr 12 07:49:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 182/547] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:49:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 07:49:49 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-997e6b4e-7ddc-478d-9d1e-510cc08c18a0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:49 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-997e6b4e-7ddc-478d-9d1e-510cc08c18a0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:49 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-997e6b4e-7ddc-478d-9d1e-510cc08c18a0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-997e6b4e-7ddc-478d-9d1e-510cc08c18a0 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 200 len: 1090 microversion: 2.1 time: 0.076899 Apr 12 07:49:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 183/548] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:49 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 1090 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:49 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-216955781", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "b8a83b38-0d35-47f7-9c68-5c0606d94c19"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-671601953", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26"}], "security_groups": [{"name": "tempest-securitygroup--1429794379"}], "key_name": "tempest-keypair-10133080", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:49 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] validate_networks() for [('b8a83b38-0d35-47f7-9c68-5c0606d94c19', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] validate_networks() for [('7c7efbb9-63c5-4ad0-b7d3-82a16f6bce26', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:49:49 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for project f7915d29fb124c838093eba0ee6cb69c. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Getting quotas for user a555fa5e6680420e80fcc925a7540806 and project f7915d29fb124c838093eba0ee6cb69c. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for user 2c01e1260cfa45f6b9d225592867f240 and project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:49:50 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-5d60190e-c2dd-43a7-be60-455db7ac7bf0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.717005 Apr 12 07:49:50 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 183/549] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:49:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-520282ac-b9d9-4ddd-beef-c2543cdd5306 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-520282ac-b9d9-4ddd-beef-c2543cdd5306 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0d4d1366-cae7-4c71-91a1-90e761053115 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.816806 Apr 12 07:49:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 184/550] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 07:49:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-520282ac-b9d9-4ddd-beef-c2543cdd5306 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-520282ac-b9d9-4ddd-beef-c2543cdd5306 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 200 len: 1229 microversion: 2.1 time: 0.096838 Apr 12 07:49:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 184/551] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:50 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:50 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:50 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-82e16b90-5b66-44e6-a453-d3819be8662b tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1394 microversion: 2.87 time: 0.127745 Apr 12 07:49:50 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 184/552] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:49:50 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1394 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "name": "network-vif-plugged", "status": "completed", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] Creating event network-vif-plugged:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:49:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-e3d81c36-6614-4f12-ba88-ef3768377e43 req-ba172e1b-1b1f-4bfb-9c99-e0257135e114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Apr 12 07:49:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 185/553] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00258d37-14c7-4657-b9c4-c636c93811ce", "name": "network-vif-deleted", "tag": "c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] Creating event network-vif-deleted:c5aa0b1a-8e3d-45a0-b5ca-cd0ff8cc0929 for instance 00258d37-14c7-4657-b9c4-c636c93811ce on user Apr 12 07:49:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-4f606fa0-001a-4bde-847b-8fc15876e0a2 req-b61a7759-6696-4a5c-a061-155a460b3ab8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118283 Apr 12 07:49:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 185/554] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:51 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lazy-loading 'services' on Instance uuid 31672149-0612-4e15-aacd-e37c7536109c {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:49:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-942bf9b5-fea8-4ff4-905f-f28b4cd65b9a tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/3538e8ac-5519-4d52-92fc-1e55d8abdefe" status: 202 len: 0 microversion: 2.1 time: 0.177930 Apr 12 07:49:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 185/555] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:49:51 2023] DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments/3538e8ac-5519-4d52-92fc-1e55d8abdefe => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d737a1e7-ff12-4273-8a18-fae55869f66f tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Apr 12 07:49:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 186/556] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:49:51 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:53 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:49:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] Creating event network-changed:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-9e8b454a-7c3b-4b9e-8d1b-e212bc8c4fbc req-977655f6-fcf2-4cec-ac6a-7535b203fc4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051301 Apr 12 07:49:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 186/557] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:53 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'flavor' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:49:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1bc46ea2-c8ad-4a7b-b3c9-7f828350d2be tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/action" status: 200 len: 32 microversion: 2.1 time: 0.181453 Apr 12 07:49:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 186/558] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:49:53 2023] POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:53 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:49:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b6587274-8a09-42fd-878e-607b650e26fc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1720 microversion: 2.1 time: 0.280336 Apr 12 07:49:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:49:53 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:49:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] Creating event network-changed:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:49:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-c6a09eb4-fce7-4c96-892a-7d7dbf77b9bc req-1998cf46-1f88-4ad5-b324-922a80f54a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086705 Apr 12 07:49:54 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 187/560] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] Creating event network-changed:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:49:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-916a4b0c-48c4-427d-bc04-1191c8fc8175 req-17937188-438e-4caa-8bcd-9e037bf7cf81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Apr 12 07:49:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 187/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:49:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-unplugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}, {"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:49:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:49:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:49:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:49:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Creating event network-vif-unplugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:49:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:49:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-b20f8f0c-62fb-4c98-a43a-d8d13654d583 req-45451c6f-a685-49cc-afac-15f194f0b4a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035553 Apr 12 07:49:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 188/562] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "name": "network-vif-plugged", "status": "completed", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] Creating event network-vif-plugged:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:50:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-e21c96f4-9498-408e-b0bd-a9fd2f0be878 req-f4f5be07-1178-4002-9447-d825bf5732a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044794 Apr 12 07:50:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 188/563] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=18 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "name": "network-vif-plugged", "status": "completed", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] Creating event network-vif-plugged:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:50:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-ec700d7c-be54-4715-9e30-441fd1fa4811 req-86a3fef9-6e6f-4f21-9896-c4a5b65c9e8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035826 Apr 12 07:50:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 188/564] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-a3e06873-ce28-4460-92c5-dd26a67e7e02 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action" status: 202 len: 0 microversion: 2.1 time: 0.189229 Apr 12 07:50:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 189/565] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:50:01 2023] POST /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:01 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e5e5da27-d790-4d95-9ac1-1482efda301a tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1727 microversion: 2.1 time: 0.170794 Apr 12 07:50:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 189/566] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:01 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "name": "network-vif-plugged", "status": "completed", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}, {"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}, {"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Creating event network-vif-plugged:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:50:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:50:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:50:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-168184d8-7b66-469a-800c-b8bb05e46985 req-ebc2dba5-50e0-4998-b0dc-1d8615fda7ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035797 Apr 12 07:50:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 189/567] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "name": "network-vif-plugged", "status": "completed", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}, {"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-unplugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}, {"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Creating event network-vif-plugged:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:50:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Creating event network-vif-unplugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:50:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:50:03 user devstack@n-api.service[72696]: DEBUG nova.compute.api [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72696) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:50:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-5fe3c1ea-6852-4b1c-a5a7-8b63fdcdddd1 req-2a010275-6b3d-4d46-9e72-ce1001833bfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.053776 Apr 12 07:50:03 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:50:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-3c01ce2e-904f-462b-af4c-f832ad3d1972 req-6ac6d307-3dda-444a-9383-bfea3e2a4aa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045139 Apr 12 07:50:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 190/569] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:50:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-b1bb441a-f200-441a-96a3-0e62cbca5503 req-86b0e69a-1115-4d68-9585-f4d831471901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039644 Apr 12 07:50:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 190/570] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:13 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ffb8e7b9-ff9b-44fe-970e-1c8f5b9a19ec tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1534 microversion: 2.1 time: 0.191842 Apr 12 07:50:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 191/571] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:13 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1534 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:50:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:50:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6f9e8f4f-cd5a-4428-9ca1-57fca2bd0b9c req-7ec41633-864f-43d8-96f5-56e24c4a3264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107315 Apr 12 07:50:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 191/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:50:17 user devstack@n-api.service[72695]: DEBUG nova.compute.api [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] Instance 3b7424e4-52aa-4330-a748-006240372716 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72695) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:50:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-ce878d8b-b772-49fb-be98-d4831108f757 req-cf8ddfac-2a3e-4779-a0e0-f55ac1395fe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062651 Apr 12 07:50:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 191/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:50:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f095e67c-2268-49b9-9e17-35627b3423c7 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" status: 204 len: 0 microversion: 2.1 time: 0.146958 Apr 12 07:50:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 192/574] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:50:31 2023] DELETE /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=11 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:31 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66018ab9b9c54fc593b4f872f6ef4c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853e85be61864e66b0b8e8be4e3059fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b859d1ac-7561-49e2-9190-4e450d4d8077 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" status: 200 len: 1459 microversion: 2.1 time: 0.188072 Apr 12 07:50:31 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 192/575] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:31 2023] GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => generated 1459 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "name": "network-vif-unplugged", "status": "completed", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] Creating event network-vif-unplugged:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:50:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-1bc34ca3-afdc-4654-9d26-82f749c5c12a req-f3ecfbfc-19b5-41bb-a386-0249e2a0bdee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034577 Apr 12 07:50:31 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 192/576] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "name": "network-vif-deleted", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] Creating event network-vif-deleted:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:50:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f56ca8f8-2c5f-46f5-9c86-8c591c79a9e8 req-c0ceb8f8-0c5b-4b0f-bf5d-da4b30c7fdee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034119 Apr 12 07:50:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 193/577] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16", "name": "network-vif-plugged", "status": "completed", "tag": "43a66fc3-42b3-49e6-bbb8-514842e2200f"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] Creating event network-vif-plugged:43a66fc3-42b3-49e6-bbb8-514842e2200f for instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 on user Apr 12 07:50:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a403d74f-af33-4497-81ec-a9ccf4b4baef req-508619d3-0b20-48a4-925e-5ee9b7f6890f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Apr 12 07:50:33 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 193/578] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: 00258d37-14c7-4657-b9c4-c636c93811ce] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] HTTP exception thrown: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Request method failure captured: Apr 12 07:50:36 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce HTTP/1.1 Apr 12 07:50:36 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:50:36 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:50:36 user devstack@n-api.service[72695]: Connection: close Apr 12 07:50:36 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:50:36 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:50:36 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:50:36 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:50:36 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmIPmN6fXXFWmh8WvVV8sXcC7Snm1OFoozyhdd67PfHPXT43NLCtZZ48v3DiQbcg3glcaObbGuPkiZfBitG5LHDaph2mF5LOAiYH_gZNUhwlbR5hkZpKTWbEtYu-ERfYqKBeChcth-F1yATWjV117F_sZGYY9jUS8bofl_I6f62f5uM Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Project-Id: 468e9932c7634b0d8c3257ee14a66959 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Tenant-Id: 468e9932c7634b0d8c3257ee14a66959 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:50:36 user devstack@n-api.service[72695]: X-User: tempest-VolumesSnapshotTestJSON-1434579998-project-member Apr 12 07:50:36 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:50:36 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:50:36 user devstack@n-api.service[72695]: X-User-Id: 76d4eef76f634fb39c1f0895abfbd17d Apr 12 07:50:36 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434579998-project-member Apr 12 07:50:36 user devstack@n-api.service[72695]: method: > Apr 12 07:50:36 user devstack@n-api.service[72695]: exception: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. Apr 12 07:50:36 user devstack@n-api.service[72695]: action_args: {'id': '00258d37-14c7-4657-b9c4-c636c93811ce'} Apr 12 07:50:36 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. Apr 12 07:50:36 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:50:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Returning 404 to user: Instance 00258d37-14c7-4657-b9c4-c636c93811ce could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:50:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3d72468b-fc54-49ff-82f7-cb17f65191b9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce" status: 404 len: 111 microversion: 2.1 time: 0.030674 Apr 12 07:50:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 193/579] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:36 2023] GET /compute/v2.1/servers/00258d37-14c7-4657-b9c4-c636c93811ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:39 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-078a846f-37ec-4fc7-ba12-3e57053ba381 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 200 len: 1442 microversion: 2.1 time: 0.154408 Apr 12 07:50:39 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 194/580] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:39 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:40 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d231a92f-9e7c-4ff7-a066-6f6fdf8d9b89 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 200 len: 1534 microversion: 2.1 time: 0.217107 Apr 12 07:50:40 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 194/581] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:40 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 1534 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:40 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fc740283-82bf-4aaa-96d9-68c19a97c471 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1768 microversion: 2.87 time: 0.196905 Apr 12 07:50:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 194/582] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:50:40 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1768 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-575afe47-9ca0-4010-a75d-e1ad7576d5e3 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049397 Apr 12 07:50:42 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 195/583] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:50:42 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c9dfbd34-99d1-4b4c-8587-cbbb8a039488 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1700 microversion: 2.1 time: 0.331888 Apr 12 07:50:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 195/584] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:43 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1700 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-424170650", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "a5752d9a-79d5-4f8c-877b-1aeb615c2285"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:45 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] validate_networks() for [('a5752d9a-79d5-4f8c-877b-1aeb615c2285', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting quotas for project 468e9932c7634b0d8c3257ee14a66959. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Getting quotas for user 76d4eef76f634fb39c1f0895abfbd17d and project 468e9932c7634b0d8c3257ee14a66959. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:50:46 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:50:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4ef2fb0c-1a2a-40a9-9c3a-170195178ab3 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.697160 Apr 12 07:50:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 195/585] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:50:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:50:46 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-792f8a55-2e69-4d5a-ba8e-c0ba3ba0a749 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:46 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-792f8a55-2e69-4d5a-ba8e-c0ba3ba0a749 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:46 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-792f8a55-2e69-4d5a-ba8e-c0ba3ba0a749 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-792f8a55-2e69-4d5a-ba8e-c0ba3ba0a749 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b" status: 200 len: 1212 microversion: 2.1 time: 0.071213 Apr 12 07:50:46 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 196/586] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:46 2023] GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b => generated 1212 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:49 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:49 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:49 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:49 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] Creating event network-changed:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:50:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-05fa342c-abf7-4b35-b790-ab9e3f61827c req-3ac98d34-6eae-4b28-947a-5e61c7ee6f69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 Apr 12 07:50:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 196/587] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:50:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3e712459-b0a0-4e89-b3db-815e7270d8aa req-07da10ee-507a-42c4-9dd3-f8f9921acc78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052844 Apr 12 07:50:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 196/588] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:52 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:52 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-50768266-ed74-4952-a6bf-707b7b4e83e3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.158512 Apr 12 07:50:52 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 197/589] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:51 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:50:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-9a568e1a-8a2d-4e36-a1b6-08882dcd14f3 req-e137d38b-973d-4d92-b689-220d2734a94d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Apr 12 07:50:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 197/590] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] Creating event network-changed:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:50:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-73aa15d2-ce48-4260-9b52-4f4da5f78024 req-a9957212-4b87-4929-bfda-e050703ac58a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052859 Apr 12 07:50:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 197/591] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:50:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-27b46885-af85-465b-a6f4-d29efa24db3e tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 204 len: 0 microversion: 2.1 time: 0.132505 Apr 12 07:50:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 198/592] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:50:58 2023] DELETE /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:59 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775732b835f44e7baf889683808bb3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbd1aa653244a39d6c81f2b9d669f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:50:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-07b4a5d2-324a-4d63-9b7b-92faf49abbdc tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 200 len: 1572 microversion: 2.1 time: 0.250017 Apr 12 07:50:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 198/593] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:50:58 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 1572 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:50:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "name": "network-vif-unplugged", "status": "completed", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:50:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:50:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:50:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:50:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] Creating event network-vif-unplugged:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:50:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-f7339e22-be63-48cc-bae0-4607ec2a85f9 req-8310fa95-4705-4974-beb3-20204514edbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047995 Apr 12 07:50:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 198/594] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:50:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "name": "network-vif-plugged", "status": "completed", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}, {"server_uuid": "31672149-0612-4e15-aacd-e37c7536109c", "name": "network-vif-deleted", "tag": "717e6ad1-b01a-4647-8a55-6fe494a39c4a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Creating event network-vif-plugged:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:51:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] Creating event network-vif-deleted:717e6ad1-b01a-4647-8a55-6fe494a39c4a for instance 31672149-0612-4e15-aacd-e37c7536109c on user Apr 12 07:51:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-4966668f-3fa1-494b-b1f2-f1942f2839aa req-9e963ada-13da-48fb-bd7e-72aab040b0b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031097 Apr 12 07:51:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 199/595] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=14 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=30 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:13 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-86b632cc-5ecd-4e7a-a4ec-b25de3e4f54a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1534 microversion: 2.1 time: 0.166175 Apr 12 07:51:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 199/596] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:13 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1534 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:13 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching by: {'deleted': False, 'project_id': '27f4f7b1930e48cb82f5f6010872e221'} {{(pid=72695) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=18 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:14 user devstack@n-api.service[72695]: DEBUG nova.compute.multi_cell_list [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72695) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 07:51:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-df4c6505-2452-4371-b057-db7028257046 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.196578 Apr 12 07:51:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 199/597] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 07:51:13 2023] GET /compute/v2.1/servers => generated 340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:14 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ef2b49ec-713c-45a3-97f5-cf2f95a3386a tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1534 microversion: 2.1 time: 0.177342 Apr 12 07:51:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 200/598] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:14 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "957dad42-1b5b-4347-b512-2459774d09f4"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0d82f2c5-af88-4b9c-84c5-a1e0a5d2a9fa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281331 Apr 12 07:51:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 200/599] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:51:15 2023] POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] [instance: bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] HTTP exception thrown: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Request method failure captured: Apr 12 07:51:21 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 HTTP/1.1 Apr 12 07:51:21 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:51:21 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:51:21 user devstack@n-api.service[72695]: Connection: close Apr 12 07:51:21 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:51:21 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:51:21 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:51:21 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:51:21 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmJWRuu8MQvQTqmAoHfXbBnWPYiPGgWTOKm0vqy35MZ_mwLr-XoGigE-6RO1GWIpXzBNHYf1WRpn6QDGyHWhHJQn97gPZVVNlhrx3eIhFip1TBz03oDIVFiP8JjN0vxDaiDt7TQas9mLeYIzd7ff6xp-mCjSfvCaGHV-YSdSW4NyakE Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Project-Id: 853e85be61864e66b0b8e8be4e3059fa Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesNegativeTest-653023601 Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853e85be61864e66b0b8e8be4e3059fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/853e85be61864e66b0b8e8be4e3059fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/853e85be61864e66b0b8e8be4e3059fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesNegativeTest-653023601 Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Tenant-Id: 853e85be61864e66b0b8e8be4e3059fa Apr 12 07:51:21 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesNegativeTest-653023601 Apr 12 07:51:21 user devstack@n-api.service[72695]: X-User: tempest-VolumesNegativeTest-653023601-project-member Apr 12 07:51:21 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:51:21 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:51:21 user devstack@n-api.service[72695]: X-User-Id: 66018ab9b9c54fc593b4f872f6ef4c9a Apr 12 07:51:21 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesNegativeTest-653023601-project-member Apr 12 07:51:21 user devstack@n-api.service[72695]: method: > Apr 12 07:51:21 user devstack@n-api.service[72695]: exception: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. Apr 12 07:51:21 user devstack@n-api.service[72695]: action_args: {'id': 'bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16'} Apr 12 07:51:21 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. Apr 12 07:51:21 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] Returning 404 to user: Instance bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:51:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-08a58154-ae75-47f4-9773-05e28d126653 tempest-VolumesNegativeTest-653023601 tempest-VolumesNegativeTest-653023601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16" status: 404 len: 111 microversion: 2.1 time: 0.052345 Apr 12 07:51:21 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 200/600] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:21 2023] GET /compute/v2.1/servers/bbc4ff4a-5bbe-4c04-8f10-7962fc9ddd16 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-bc391958-0d1c-47bf-a250-b4e5a48a1fd7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1580 microversion: 2.1 time: 0.251114 Apr 12 07:51:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 201/601] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:25 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1580 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] Creating event network-changed:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-23fec239-8d66-48c0-962a-6ae98c559a0f req-e86a6859-6449-4756-95f0-c9791b90bb96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047580 Apr 12 07:51:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 201/602] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1564341154"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:29 user devstack@n-api.service[72695]: INFO nova.network.security_group_api [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Adding security group c357f292-3292-4966-8f98-4f4d8fbb9a09 to port 8c395303-b043-4eef-a6ac-e567893e6de4 Apr 12 07:51:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-be47fd39-454a-4b79-8e90-143c438a0157 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action" status: 202 len: 0 microversion: 2.1 time: 0.656867 Apr 12 07:51:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 201/603] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:51:29 2023] POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:51:29 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] Creating event network-changed:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-2baf282e-e23f-4659-84d5-cc28a16f28a8 req-b9b12760-3212-4af5-b919-0dffe1cbed59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036287 Apr 12 07:51:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 202/604] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:29 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7bb5f392-d554-4de5-b49a-6cd5eed3ca46 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1746 microversion: 2.1 time: 0.180922 Apr 12 07:51:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 202/605] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:29 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a857fba3-e608-4a71-b405-28b749efa475 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action" status: 202 len: 0 microversion: 2.1 time: 0.100183 Apr 12 07:51:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 202/606] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:51:32 2023] POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:32 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-aabfac24-0746-4307-8c37-f51a5cb829a9 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1748 microversion: 2.1 time: 0.174887 Apr 12 07:51:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 203/607] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:32 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1748 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 07:51:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-unplugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] Creating event network-vif-unplugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f971915e-996e-4db7-a7bf-343e020fdcae req-91942242-cb8b-4a8d-a07a-4c53365dce80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028531 Apr 12 07:51:33 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 203/608] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-2c5a3b39-76ad-4585-8051-65f167e604d6 req-c4e55f90-223e-495f-ad0a-2ee0f9d63162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Apr 12 07:51:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 203/609] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:36 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2f522104-598d-466f-ba19-fcf198cb0281 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b" status: 200 len: 1496 microversion: 2.1 time: 0.145334 Apr 12 07:51:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 204/610] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:36 2023] GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b => generated 1496 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-d2b145a5-bf0e-4c63-a5aa-5007e2a1f25b req-62b125e8-050e-4307-b909-e3cafb9fe274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047570 Apr 12 07:51:37 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 204/611] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:51:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0f1ade0f-226e-4d92-a282-9b45b7cb2ba6 req-2d85e989-6c88-4af1-926e-57839cc66942 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031253 Apr 12 07:51:39 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 205/612] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:40 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1b41f422-8b8f-4f36-8c8b-0e182aadf55b tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 200 len: 1442 microversion: 2.1 time: 0.401847 Apr 12 07:51:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 204/613] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:39 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 1442 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:40 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:40 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-54089f4e-1a0d-449a-970a-88ab34be3ae9 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.111688 Apr 12 07:51:40 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 205/614] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:51:40 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "4304706f-f7d3-409e-81f4-fdaa40d4668a"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:40 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'flavor' on Instance uuid 4f136818-14e2-4d2e-81db-cb32a3ecd497 {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:51:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-713d5174-ed3b-4335-8f5c-bdb1be26eb52 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497/action" status: 200 len: 29 microversion: 2.87 time: 0.599355 Apr 12 07:51:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 206/615] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 07:51:40 2023] POST /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497/action => generated 29 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] Creating event network-changed:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-b78d24c7-160e-496c-a14e-59424459f2e2 req-3cd57a1d-97a4-43a9-b87f-93329282a5d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039134 Apr 12 07:51:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 205/616] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0cd4348c-6049-4ba5-9a47-0eff5afd56f7 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/ips" status: 200 len: 103 microversion: 2.1 time: 0.044008 Apr 12 07:51:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 207/617] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 07:51:41 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/ips => generated 103 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:41 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e43185f3-8f50-4d4d-88e7-cebe710b1edb tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1774 microversion: 2.87 time: 0.340244 Apr 12 07:51:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 206/618] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:51:41 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1774 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:51:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] Creating event network-changed:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:51:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-24b50606-259a-4c54-8ba7-0135968c7a41 req-de21be15-ec5d-4853-b39a-ebb0bc88f8f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069223 Apr 12 07:51:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 206/619] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:42 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:51:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ac7283b4-7efc-40a5-821e-fedcfe4a6a4a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 204 len: 0 microversion: 2.1 time: 0.140901 Apr 12 07:51:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 208/620] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:51:42 2023] DELETE /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:43 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-bf930e17-7969-4d7f-88b0-e73765ec9ba9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 200 len: 1448 microversion: 2.1 time: 0.254370 Apr 12 07:51:43 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 207/621] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:43 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 1448 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "name": "network-vif-unplugged", "status": "completed", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] Creating event network-vif-unplugged:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:51:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-78d298e2-00a9-4fc7-aee8-0abe33c9458f req-f2120289-1158-4693-a4ff-d1bade62452c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046787 Apr 12 07:51:43 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 207/622] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a46a19-ea59-4eab-b25d-491154ae8e1e"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 while it is in vm_state rescued Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Request method failure captured: Apr 12 07:51:44 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments/845065d9-ece0-4d59-b500-cb1c3f40197f HTTP/1.1 Apr 12 07:51:44 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:51:44 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:51:44 user devstack@n-api.service[72697]: Connection: close Apr 12 07:51:44 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:51:44 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:51:44 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:51:44 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:51:44 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmApYBd1x96NhnzxJC1QeMpG6tce--NfjqdsPkOw2y6gWWoQ8C_3EPX9bzMrl2ph-KqNy8ZAghfFDICMU0hTH3dj1hOtNVzkLDZuUyrPb1R52gIpQ6lGvfalxiEHQJA5t0cmosu42zOnqWapFOQ49Nx7O3mKM1ktuBpyvSwcAIVuP58 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Project-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Tenant-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:51:44 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-User: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:51:44 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:51:44 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:51:44 user devstack@n-api.service[72697]: X-User-Id: 86009132a34b466399da1701f47316d9 Apr 12 07:51:44 user devstack@n-api.service[72697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:51:44 user devstack@n-api.service[72697]: method: > Apr 12 07:51:44 user devstack@n-api.service[72697]: exception: Cannot 'detach_volume' instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 while it is in vm_state rescued Apr 12 07:51:44 user devstack@n-api.service[72697]: action_args: {'server_id': '2d96b11f-6cb6-4d16-acd3-94f7ae0c2350', 'id': '845065d9-ece0-4d59-b500-cb1c3f40197f'} Apr 12 07:51:44 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 while it is in vm_state rescued Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 while it is in vm_state rescued Apr 12 07:51:44 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Returning 409 to user: Cannot 'detach_volume' instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 while it is in vm_state rescued {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:51:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-edd8ebf5-d39c-4986-8b6f-604330277bd1 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments/845065d9-ece0-4d59-b500-cb1c3f40197f" status: 409 len: 152 microversion: 2.1 time: 0.109264 Apr 12 07:51:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 208/623] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:51:44 2023] DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments/845065d9-ece0-4d59-b500-cb1c3f40197f => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=19 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:51:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6fb50f9e-7a3f-4ee9-884f-a646d0b08d44 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/action" status: 202 len: 0 microversion: 2.1 time: 0.110708 Apr 12 07:51:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 208/624] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:51:44 2023] POST /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-fdb77e29-8cad-45e3-87d3-6feea468d220 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466865 Apr 12 07:51:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 209/625] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:51:44 2023] POST /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-unplugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}, {"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Creating event network-vif-unplugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:51:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:51:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-bbd4191e-abea-4401-9baa-c99c86d2143c req-d9c5ae73-21b3-4b9d-812b-99b2f84ed442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037261 Apr 12 07:51:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 209/626] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0f5f36c2-f829-4eac-a3e5-3fc6753dd1dc tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1708 microversion: 2.1 time: 0.235539 Apr 12 07:51:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:44 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1708 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "name": "network-vif-plugged", "status": "completed", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] Creating event network-vif-plugged:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:51:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-50175698-12c4-4366-a797-177ac01a06ea req-3740288c-ebbc-4d5f-9b6f-5f77be93ea31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068348 Apr 12 07:51:45 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 210/628] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb", "name": "network-vif-deleted", "tag": "f210361f-81f5-484d-b3a5-12fed9c8bb8b"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] Creating event network-vif-deleted:f210361f-81f5-484d-b3a5-12fed9c8bb8b for instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb on user Apr 12 07:51:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-d3385fb9-31f4-487a-9c0c-dca4747ad215 req-46f976ef-5218-4ae4-9918-83c73f773277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Apr 12 07:51:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 210/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:46 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-unplugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}, {"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:46 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Creating event network-vif-unplugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:51:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:51:46 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-5a3ff72c-4010-499e-89b6-fcb0ca583bc9 req-0116d177-6479-48bf-9863-caa6552d626e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045024 Apr 12 07:51:46 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}, {"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:51:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:51:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-baf30bb3-976e-4141-8414-d75494dd233e req-75c8b8b1-b2fa-463f-bdbe-f582ae3cb0c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031303 Apr 12 07:51:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 211/631] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] [instance: 31672149-0612-4e15-aacd-e37c7536109c] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] HTTP exception thrown: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Request method failure captured: Apr 12 07:51:49 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c HTTP/1.1 Apr 12 07:51:49 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:51:49 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:51:49 user devstack@n-api.service[72695]: Connection: close Apr 12 07:51:49 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:51:49 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:51:49 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:51:49 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:51:49 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmFWHupebuGJU63SGJZ7Onlip1NuVwNL-TxkXSlvGET52VIAdVZiNdhiLnPBQDstGNCVojrsXyR0gJzBfzZOQWObM-B6LmGdjYORDYDReb1vVuP4hwaEZ6eSJsbAC5QVJWVgpMeaW1njVGdpgylGFrTlgVEuo9B2eRDRTIoeoKEl8yY Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Project-Id: 7dbbd1aa653244a39d6c81f2b9d669f5 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Project-Name: tempest-SnapshotDataIntegrityTests-330964735 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dbbd1aa653244a39d6c81f2b9d669f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7dbbd1aa653244a39d6c81f2b9d669f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dbbd1aa653244a39d6c81f2b9d669f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Tenant: tempest-SnapshotDataIntegrityTests-330964735 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Tenant-Id: 7dbbd1aa653244a39d6c81f2b9d669f5 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-330964735 Apr 12 07:51:49 user devstack@n-api.service[72695]: X-User: tempest-SnapshotDataIntegrityTests-330964735-project-member Apr 12 07:51:49 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:51:49 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:51:49 user devstack@n-api.service[72695]: X-User-Id: 775732b835f44e7baf889683808bb3dd Apr 12 07:51:49 user devstack@n-api.service[72695]: X-User-Name: tempest-SnapshotDataIntegrityTests-330964735-project-member Apr 12 07:51:49 user devstack@n-api.service[72695]: method: > Apr 12 07:51:49 user devstack@n-api.service[72695]: exception: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. Apr 12 07:51:49 user devstack@n-api.service[72695]: action_args: {'id': '31672149-0612-4e15-aacd-e37c7536109c'} Apr 12 07:51:49 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. Apr 12 07:51:49 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:51:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Returning 404 to user: Instance 31672149-0612-4e15-aacd-e37c7536109c could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:51:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-bd9c51d6-9cc6-4b32-8ec0-2a2614465211 tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c" status: 404 len: 111 microversion: 2.1 time: 0.033811 Apr 12 07:51:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:49 2023] GET /compute/v2.1/servers/31672149-0612-4e15-aacd-e37c7536109c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:51:49 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-61a2a97e-50af-45c1-bf1f-517d8c0687bb tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] Calling method '.version_select at 0x7f7c05158e50>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:49 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-61a2a97e-50af-45c1-bf1f-517d8c0687bb tempest-SnapshotDataIntegrityTests-330964735 tempest-SnapshotDataIntegrityTests-330964735-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-33494310" status: 202 len: 0 microversion: 2.1 time: 0.037014 Apr 12 07:51:49 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 211/633] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 07:51:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-33494310 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:51:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}, {"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:51:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:51:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-db257900-4dba-46d5-9847-7155f9dcc6a4 req-829e311d-fa82-420a-a398-055cfcf547f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065998 Apr 12 07:51:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 212/634] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:52 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c3ec34e1-fdab-4b0b-87cc-a232c57193d1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.572584 Apr 12 07:51:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 212/635] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:52 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:53 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:51:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a05cc26e-efd3-4dfc-b9e6-e687c5e54cca tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1720 microversion: 2.1 time: 0.246872 Apr 12 07:51:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 212/636] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:51:52 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:54 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-822ebf02-43a1-4a27-a0e3-69910e6036cb tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061847 Apr 12 07:51:54 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 213/637] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:51:54 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:54 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-495d91b8-4513-4747-9654-4c3a538536c8 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e" status: 200 len: 194 microversion: 2.1 time: 0.076806 Apr 12 07:51:54 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 213/638] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 07:51:54 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4744ab9-f48a-40e8-8003-d614815a6f12"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:51:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:51:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-31f44885-e60e-4b77-a7cd-77a6c48779b0 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353211 Apr 12 07:51:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 213/639] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:51:56 2023] POST /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5bdeb943-b4ad-4113-a1d6-5e17a7ec31b6 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050856 Apr 12 07:52:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 214/640] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:52:04 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b0a71758-daa4-4fd3-961a-e3a8c5729413 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e" status: 200 len: 194 microversion: 2.1 time: 0.043964 Apr 12 07:52:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 214/641] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 07:52:04 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:04 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'services' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:52:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1d7b61a7-7f5b-43e7-90d9-b97ee3d4f881 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e" status: 202 len: 0 microversion: 2.1 time: 0.240090 Apr 12 07:52:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 214/642] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:52:04 2023] DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/a3a46a19-ea59-4eab-b25d-491154ae8e1e => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3aea01c2-8107-43d2-952b-f0aa4e2dea52 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/c4744ab9-f48a-40e8-8003-d614815a6f12" status: 200 len: 194 microversion: 2.1 time: 0.043498 Apr 12 07:52:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 215/643] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 07:52:06 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/c4744ab9-f48a-40e8-8003-d614815a6f12 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:07 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lazy-loading 'services' on Instance uuid b36f9b90-b2e0-4b08-8ff1-8ce3994e149d {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:52:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-abb275e0-1087-4515-b302-3e70e0f1515e tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/c4744ab9-f48a-40e8-8003-d614815a6f12" status: 202 len: 0 microversion: 2.1 time: 0.161973 Apr 12 07:52:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 215/644] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:52:07 2023] DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments/c4744ab9-f48a-40e8-8003-d614815a6f12 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c7ea6b85-045f-47cd-9305-f94cc41e9a77 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076860 Apr 12 07:52:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 215/645] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:52:09 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-fb418081-a760-464d-a7ef-312db634c053 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042131 Apr 12 07:52:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 216/646] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:52:09 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:52:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1bde4356-7087-4d32-8f3a-37e003f9532a tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 204 len: 0 microversion: 2.1 time: 0.119291 Apr 12 07:52:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 216/647] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:52:09 2023] DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "name": "network-vif-unplugged", "status": "completed", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:10 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a555fa5e6680420e80fcc925a7540806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7915d29fb124c838093eba0ee6cb69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:10 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9b47f65b-4218-40d8-8399-df0bd879dc45 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 200 len: 1659 microversion: 2.1 time: 0.288569 Apr 12 07:52:10 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:09 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 1659 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] Creating event network-vif-unplugged:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:52:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-432ec89e-81e6-4a77-bfdd-1e1101c98a4d req-7a9d0fb2-c4b9-44e8-a089-52b7d6a8f7ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029887 Apr 12 07:52:10 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 217/649] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "name": "network-vif-deleted", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] Creating event network-vif-deleted:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:52:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-59132955-7b27-4205-8a3c-6879aa0fd291 req-f1005f94-3958-4470-be75-03f69dbf8ef5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035445 Apr 12 07:52:11 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 217/650] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f9b90-b2e0-4b08-8ff1-8ce3994e149d", "name": "network-vif-plugged", "status": "completed", "tag": "c6274ef0-ab83-498a-b9da-38ce679c28e9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] Creating event network-vif-plugged:c6274ef0-ab83-498a-b9da-38ce679c28e9 for instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d on user Apr 12 07:52:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-bbf9c67a-e0e3-45e6-92d6-b1c3f8b5daa1 req-c092d576-989f-4a47-87bf-1290ad1d06d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Apr 12 07:52:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 217/651] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=7 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=19 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:22 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-132c1253-a819-4d2a-9365-0725d8ca9731 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1746 microversion: 2.1 time: 0.167710 Apr 12 07:52:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 218/652] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:22 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:32 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cd8e0bdb-2e21-4c3f-8459-aaf78eb768a9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1754 microversion: 2.87 time: 0.420012 Apr 12 07:52:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 218/653] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:52:31 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1754 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=7 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:52:33 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb HTTP/1.1 Apr 12 07:52:33 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:52:33 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:52:33 user devstack@n-api.service[72697]: Connection: close Apr 12 07:52:33 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:52:33 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:52:33 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:52:33 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:52:33 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:52:33 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:52:33 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:52:33 user devstack@n-api.service[72697]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:52:33 user devstack@n-api.service[72697]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:52:33 user devstack@n-api.service[72697]: method: > Apr 12 07:52:33 user devstack@n-api.service[72697]: exception: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:52:33 user devstack@n-api.service[72697]: action_args: {'id': '53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb'} Apr 12 07:52:33 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:52:33 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:52:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:52:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-24cfd1dc-dac3-43b2-857d-1e62f1981945 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 404 len: 111 microversion: 2.1 time: 0.042541 Apr 12 07:52:33 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 218/654] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:33 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:52:33 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-526182795", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1580615295", "security_groups": [{"name": "tempest-secgroup-smoke-278447882"}], "block_device_mapping_v2": [{"uuid": "fe954cd5-982e-420d-b3e2-6da8bff98d9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:33 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:33 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:33 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:52:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe954cd5-982e-420d-b3e2-6da8bff98d9f',volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:52:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-de2de45b-fe07-458d-a83f-78d0780be118 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.784096 Apr 12 07:52:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 219/655] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:52:33 2023] POST /compute/v2.1/servers => generated 403 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:52:34 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b9f4e4bd-d83d-4dbf-b9de-6d88711ed329 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:34 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b9f4e4bd-d83d-4dbf-b9de-6d88711ed329 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:34 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b9f4e4bd-d83d-4dbf-b9de-6d88711ed329 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:34 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b9f4e4bd-d83d-4dbf-b9de-6d88711ed329 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 200 len: 1089 microversion: 2.1 time: 0.074245 Apr 12 07:52:34 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 219/656] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:34 2023] GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:35 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1d0efbc7-0ad6-4c75-b063-ad5e625be90b tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1714 microversion: 2.1 time: 0.161536 Apr 12 07:52:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 219/657] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:35 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44a5f2d9-dda3-4068-a009-8966651e4275", "device": "/dev/vdb"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] Creating event network-changed:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:52:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3937e5da-ce08-49c7-bb33-a7e5028ee121 req-a7e30c7f-142b-4e4c-ac4f-c0aee005bd9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047337 Apr 12 07:52:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 220/658] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8f4c707c-4ff0-4ce5-a75c-99486853eaec tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932891 Apr 12 07:52:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 220/659] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:52:36 2023] POST /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "name": "network-vif-plugged", "status": "completed", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] Creating event network-vif-plugged:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:52:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-692947c9-b311-44b1-9f95-8021292d8233 req-9a4fdf0e-451b-49a4-ba1c-c34fdc50a052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041479 Apr 12 07:52:45 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 220/660] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "name": "network-vif-plugged", "status": "completed", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:47 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] Creating event network-vif-plugged:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:52:47 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-4ea1bd65-49db-4397-9479-4bef2c5ce2c7 req-1e7ececc-3237-4fbd-b4ae-8c78339e8052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Apr 12 07:52:47 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 221/661] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:53 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:52:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e4622f21-f0a2-4005-935a-fbc23da80a45 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 204 len: 0 microversion: 2.1 time: 0.148908 Apr 12 07:52:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 221/662] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:52:53 2023] DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:53 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:53 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b07abe4b-e7cf-4fcc-9b22-8e4545ad8b19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 200 len: 1726 microversion: 2.1 time: 0.189102 Apr 12 07:52:53 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 221/663] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:53 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-unplugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] Creating event network-vif-unplugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:52:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-00d86a4f-1139-4fb7-b367-f5eeee84e1c0 req-6c42d55d-b6ba-4286-864f-70cd905a4c5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033504 Apr 12 07:52:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 222/664] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-deleted", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] Creating event network-vif-deleted:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:52:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-2aface46-f96a-4192-a9cd-9faf0d4f71aa req-767622ab-694a-4067-8ac2-c5c4cc95e5f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033694 Apr 12 07:52:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 222/665] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7424e4-52aa-4330-a748-006240372716", "name": "network-vif-plugged", "status": "completed", "tag": "d24db70b-543b-4549-8c33-b8276a776c3d"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] Creating event network-vif-plugged:d24db70b-543b-4549-8c33-b8276a776c3d for instance 3b7424e4-52aa-4330-a748-006240372716 on user Apr 12 07:52:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-e6c1c6e3-fd52-4775-96af-3cb52bb05f8a req-02e9a4c8-6764-4c7b-9b18-909609aa9649 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Apr 12 07:52:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:57 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lazy-loading 'services' on Instance uuid c33e7825-1766-472a-8f09-c17a239fe63b {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:52:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c11ea971-4980-4b0d-a9be-498effbb645a tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b/os-volume_attachments/44a5f2d9-dda3-4068-a009-8966651e4275" status: 202 len: 0 microversion: 2.1 time: 0.214984 Apr 12 07:52:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 223/667] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:52:57 2023] DELETE /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b/os-volume_attachments/44a5f2d9-dda3-4068-a009-8966651e4275 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:57 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:52:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3a91813c-8a37-4071-a9aa-39d8507bf4c9 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b" status: 204 len: 0 microversion: 2.1 time: 0.113374 Apr 12 07:52:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 223/668] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:52:57 2023] DELETE /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:58 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d4eef76f634fb39c1f0895abfbd17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468e9932c7634b0d8c3257ee14a66959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:52:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7e4ee2c3-93cd-4a2b-9e6e-261a659a1a27 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b" status: 200 len: 1548 microversion: 2.1 time: 0.155801 Apr 12 07:52:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 223/669] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:52:57 2023] GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:52:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-unplugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:52:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:52:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:52:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:52:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] Creating event network-vif-unplugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:52:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-d83a309c-b03d-4c71-95ce-cba297e69b11 req-7791e65c-5a3f-48eb-9684-82df26f473d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032250 Apr 12 07:52:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 224/670] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:53:00 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d HTTP/1.1 Apr 12 07:53:00 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:53:00 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:53:00 user devstack@n-api.service[72696]: Connection: close Apr 12 07:53:00 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:53:00 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:53:00 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:53:00 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:53:00 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:00 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:00 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:00 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:53:00 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:53:00 user devstack@n-api.service[72696]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:53:00 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:00 user devstack@n-api.service[72696]: method: > Apr 12 07:53:00 user devstack@n-api.service[72696]: exception: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:00 user devstack@n-api.service[72696]: action_args: {'id': 'b36f9b90-b2e0-4b08-8ff1-8ce3994e149d'} Apr 12 07:53:00 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:00 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-677767b1-7a2f-47c0-9765-6f41b9a8d1fc tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 404 len: 111 microversion: 2.1 time: 0.055974 Apr 12 07:53:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 224/671] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:00 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-df7c8575-eaf1-4882-80aa-7f1972699607 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '.version_select at 0x7f7bf47c3e20>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-df7c8575-eaf1-4882-80aa-7f1972699607 tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10133080" status: 202 len: 0 microversion: 2.1 time: 0.042458 Apr 12 07:53:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 224/672] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 07:53:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10133080 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:53:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-deleted", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] Creating event network-vif-deleted:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7b6e81c8-ee05-4d63-aa8d-b89b5c9fb63e req-8224ba10-e3bf-4f17-99d7-f26c3a2ebfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043552 Apr 12 07:53:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 225/673] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}, {"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}, {"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}, {"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-unplugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}, {"server_uuid": "c33e7825-1766-472a-8f09-c17a239fe63b", "name": "network-vif-plugged", "status": "completed", "tag": "5717efd2-8b2e-42b5-bd06-baa345aab97c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Creating event network-vif-unplugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] Creating event network-vif-plugged:5717efd2-8b2e-42b5-bd06-baa345aab97c for instance c33e7825-1766-472a-8f09-c17a239fe63b on user Apr 12 07:53:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0949d3df-9f5a-4135-ab74-bdcee5789ffe req-1aa44596-d4ad-402c-8a8d-7b4538245619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031797 Apr 12 07:53:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 225/674] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:53:05 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d HTTP/1.1 Apr 12 07:53:05 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:53:05 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:53:05 user devstack@n-api.service[72697]: Connection: close Apr 12 07:53:05 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:53:05 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:53:05 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:53:05 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:53:05 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:05 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:05 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:53:05 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:53:05 user devstack@n-api.service[72697]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:53:05 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:05 user devstack@n-api.service[72697]: method: > Apr 12 07:53:05 user devstack@n-api.service[72697]: exception: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72697]: action_args: {'id': 'b36f9b90-b2e0-4b08-8ff1-8ce3994e149d'} Apr 12 07:53:05 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7402f048-ffcb-4011-ab3f-88156a0882da tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 404 len: 111 microversion: 2.1 time: 0.041342 Apr 12 07:53:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 225/675] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:53:05 2023] DELETE /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: b36f9b90-b2e0-4b08-8ff1-8ce3994e149d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:53:05 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d HTTP/1.1 Apr 12 07:53:05 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:53:05 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:53:05 user devstack@n-api.service[72695]: Connection: close Apr 12 07:53:05 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:53:05 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:53:05 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:53:05 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:53:05 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:05 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:05 user devstack@n-api.service[72695]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:05 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:53:05 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:53:05 user devstack@n-api.service[72695]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:53:05 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:05 user devstack@n-api.service[72695]: method: > Apr 12 07:53:05 user devstack@n-api.service[72695]: exception: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72695]: action_args: {'id': 'b36f9b90-b2e0-4b08-8ff1-8ce3994e149d'} Apr 12 07:53:05 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. Apr 12 07:53:05 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance b36f9b90-b2e0-4b08-8ff1-8ce3994e149d could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-dd009b9c-bd1f-48f5-938d-36613910230d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d" status: 404 len: 111 microversion: 2.1 time: 0.031893 Apr 12 07:53:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 226/676] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:05 2023] GET /compute/v2.1/servers/b36f9b90-b2e0-4b08-8ff1-8ce3994e149d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:53:07 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 HTTP/1.1 Apr 12 07:53:07 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:53:07 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:53:07 user devstack@n-api.service[72696]: Connection: close Apr 12 07:53:07 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:53:07 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:53:07 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:53:07 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:53:07 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:07 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:07 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:53:07 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:53:07 user devstack@n-api.service[72696]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:53:07 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:07 user devstack@n-api.service[72696]: method: > Apr 12 07:53:07 user devstack@n-api.service[72696]: exception: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72696]: action_args: {'id': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'} Apr 12 07:53:07 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-1292986a-381e-4346-9dd7-8028e4cc257d tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 404 len: 111 microversion: 2.1 time: 0.043120 Apr 12 07:53:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 226/677] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:53:07 2023] DELETE /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] [instance: f79ca8ec-41b5-4b60-882f-d74d906fb8e6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] HTTP exception thrown: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Request method failure captured: Apr 12 07:53:07 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 HTTP/1.1 Apr 12 07:53:07 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:53:07 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:53:07 user devstack@n-api.service[72697]: Connection: close Apr 12 07:53:07 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:53:07 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:53:07 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:53:07 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:53:07 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAlItJaCeZhkpRNPshCsoYCtik5XqQIBirfKF0FOzdm4eXw0_IYCma6ZX8auoJ_LmrAQZ03JjyyUaTfRwhZsUO8azksTQWQXodc3c8K2ZQcQBgJGYJg8_sEbGxDnTZNH57ozkqCeCdR5zzUa7EmNY1eFgkqKuNeMNQJhGjOHj5KNfQ Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Project-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7915d29fb124c838093eba0ee6cb69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Tenant-Id: f7915d29fb124c838093eba0ee6cb69c Apr 12 07:53:07 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1353175840 Apr 12 07:53:07 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:07 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:53:07 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:53:07 user devstack@n-api.service[72697]: X-User-Id: a555fa5e6680420e80fcc925a7540806 Apr 12 07:53:07 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeTestJSON-1353175840-project-member Apr 12 07:53:07 user devstack@n-api.service[72697]: method: > Apr 12 07:53:07 user devstack@n-api.service[72697]: exception: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72697]: action_args: {'id': 'f79ca8ec-41b5-4b60-882f-d74d906fb8e6'} Apr 12 07:53:07 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. Apr 12 07:53:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] Returning 404 to user: Instance f79ca8ec-41b5-4b60-882f-d74d906fb8e6 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-3bb7836e-8bea-4e6a-87e4-b3c034c19fdf tempest-AttachVolumeTestJSON-1353175840 tempest-AttachVolumeTestJSON-1353175840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6" status: 404 len: 111 microversion: 2.1 time: 0.029501 Apr 12 07:53:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 226/678] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:07 2023] GET /compute/v2.1/servers/f79ca8ec-41b5-4b60-882f-d74d906fb8e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1564341154"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=12 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:23 user devstack@n-api.service[72695]: INFO nova.network.security_group_api [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Removing security group c357f292-3292-4966-8f98-4f4d8fbb9a09 from port 8c395303-b043-4eef-a6ac-e567893e6de4 Apr 12 07:53:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-636c8658-bc84-443a-9c41-3d7630df7084 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action" status: 202 len: 0 microversion: 2.1 time: 0.608619 Apr 12 07:53:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 227/679] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:53:23 2023] POST /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] Creating event network-changed:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:53:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-68042ef4-77e5-4ada-aff9-e66b92f53ad0 req-6286651a-3894-4d99-9dfe-ace62acb6466 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042612 Apr 12 07:53:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 227/680] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=20 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:24 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'services' on Instance uuid 40c8d6d7-d840-4417-b897-92ff8258d984 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:53:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-222ba0eb-f6af-430f-80de-2d2ec40bd2d3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments/957dad42-1b5b-4347-b512-2459774d09f4" status: 202 len: 0 microversion: 2.1 time: 0.229841 Apr 12 07:53:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 228/681] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:53:25 2023] DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments/957dad42-1b5b-4347-b512-2459774d09f4 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:53:25 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:25 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2d98d59b-b5ed-4560-a379-e154e9a3f149 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 200 len: 1441 microversion: 2.1 time: 0.707226 Apr 12 07:53:25 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 227/682] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:24 2023] GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 1441 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-651a649a-2258-4eeb-8d83-3266b8402f38 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080404 Apr 12 07:53:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 228/683] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:53:25 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] Creating event network-changed:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:53:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-9bbe918e-e386-478d-a0ce-28f0d03bc9c1 req-d80fc39c-e856-4e49-831e-da0a465c40b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040259 Apr 12 07:53:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 229/684] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4da5337e-353e-4ba5-8b84-3bff31f4ce04 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497/action" status: 202 len: 0 microversion: 2.87 time: 0.082878 Apr 12 07:53:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 228/685] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 07:53:32 2023] POST /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:32 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:32 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3e68c6b5-e847-4849-8b6c-008e1170b93a tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1762 microversion: 2.87 time: 0.268781 Apr 12 07:53:32 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 229/686] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:53:32 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1762 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:53:33 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-unplugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:33 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] Creating event network-vif-unplugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:53:33 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-2da0a76f-1228-456c-98a9-6e5201c13676 req-4431a823-a153-417f-87c2-e756b9fad878 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036311 Apr 12 07:53:33 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-bd83026a-0c53-454f-9c3d-75157909a42c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.114551 Apr 12 07:53:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 229/688] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:53:35 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-interface => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:35 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}, {"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:53:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:53:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d8968986-4dfc-4c3d-916c-83ebd8c8484e req-2dcad72c-3e1d-4e78-bb21-1500aa6c133d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038503 Apr 12 07:53:35 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 230/689] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] Creating event network-changed:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:53:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fdfc0bb5-c7e9-47b0-bc7c-a9c8acd08cd0 req-ad1d869c-39f2-46fe-ad97-3f18a14e975f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047205 Apr 12 07:53:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 231/690] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:36 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lazy-loading 'services' on Instance uuid 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:53:36 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8990c73f-41eb-4b29-8599-f7f942c69c2c tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments/845065d9-ece0-4d59-b500-cb1c3f40197f" status: 202 len: 0 microversion: 2.1 time: 0.162494 Apr 12 07:53:36 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 230/691] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:53:36 2023] DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments/845065d9-ece0-4d59-b500-cb1c3f40197f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-31270cd5-5ec2-49d1-8647-a2bb0f65df16 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111673 Apr 12 07:53:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 231/692] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:53:36 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 07:53:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-bcf6fec6-cac3-4556-b8ed-b39c5549aeb4 req-c4821a56-0943-4bd5-a397-02edb69d8924 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039322 Apr 12 07:53:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 232/693] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:38 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] Creating event network-changed:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:53:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-06f3e040-a56c-43ca-992e-e641322afa67 req-367273ed-e87d-4636-ad48-90c2b03a1651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031202 Apr 12 07:53:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 231/694] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 07:53:43 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 HTTP/1.1 Apr 12 07:53:43 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:53:43 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:53:43 user devstack@n-api.service[72696]: Connection: close Apr 12 07:53:43 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:53:43 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:53:43 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:53:43 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:53:43 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72696]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72696]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 07:53:43 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72696]: method: > Apr 12 07:53:43 user devstack@n-api.service[72696]: exception: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72696]: action_args: {'id': '3b7424e4-52aa-4330-a748-006240372716'} Apr 12 07:53:43 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-bf6f9049-3a21-4a86-b251-1720c199a7f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 404 len: 111 microversion: 2.1 time: 0.032652 Apr 12 07:53:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 232/695] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:43 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 07:53:43 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments HTTP/1.1 Apr 12 07:53:43 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:53:43 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:53:43 user devstack@n-api.service[72695]: Connection: close Apr 12 07:53:43 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:53:43 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:53:43 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:53:43 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:53:43 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72695]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72695]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 07:53:43 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72695]: method: > Apr 12 07:53:43 user devstack@n-api.service[72695]: exception: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72695]: action_args: {'server_id': '3b7424e4-52aa-4330-a748-006240372716'} Apr 12 07:53:43 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-abe03407-726e-45fe-8a3e-2652e743fe19 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035654 Apr 12 07:53:43 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 233/696] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:53:43 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 07:53:43 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 HTTP/1.1 Apr 12 07:53:43 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:53:43 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:53:43 user devstack@n-api.service[72697]: Connection: close Apr 12 07:53:43 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:53:43 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:53:43 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:53:43 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:53:43 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 07:53:43 user devstack@n-api.service[72697]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:53:43 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:53:43 user devstack@n-api.service[72697]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 07:53:43 user devstack@n-api.service[72697]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 07:53:43 user devstack@n-api.service[72697]: method: > Apr 12 07:53:43 user devstack@n-api.service[72697]: exception: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72697]: action_args: {'id': '3b7424e4-52aa-4330-a748-006240372716'} Apr 12 07:53:43 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 07:53:43 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:53:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-37c5333b-ad8e-4a36-ae8b-e2a7650e2414 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 404 len: 111 microversion: 2.1 time: 0.032810 Apr 12 07:53:43 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 232/697] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:43 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2014431968", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "af815a31-5dc3-45af-a83e-9a4374f8315f"}], "security_groups": [{"name": "tempest-securitygroup--119662826"}], "key_name": "tempest-keypair-562229555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:43 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] validate_networks() for [('af815a31-5dc3-45af-a83e-9a4374f8315f', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:53:44 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:53:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-9009e5fa-e154-475b-bbb2-54aa31a50d81 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.623048 Apr 12 07:53:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 233/698] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:53:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:53:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1cccaf1a-299b-427c-b96a-d883a9e40871 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:44 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1cccaf1a-299b-427c-b96a-d883a9e40871 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:44 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1cccaf1a-299b-427c-b96a-d883a9e40871 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1cccaf1a-299b-427c-b96a-d883a9e40871 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 200 len: 1232 microversion: 2.1 time: 0.117862 Apr 12 07:53:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 234/699] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:44 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 1232 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:53:47 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] Creating event network-changed:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 07:53:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-eff080aa-1ddb-40d1-8fdb-995210fb8dc9 req-1a17e020-d851-4f33-a8fc-5215d73aa84c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034480 Apr 12 07:53:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 233/700] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] [instance: c33e7825-1766-472a-8f09-c17a239fe63b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] HTTP exception thrown: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Request method failure captured: Apr 12 07:53:48 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b HTTP/1.1 Apr 12 07:53:48 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:53:48 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:53:48 user devstack@n-api.service[72696]: Connection: close Apr 12 07:53:48 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:53:48 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:53:48 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:53:48 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:53:48 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmIPmN6fXXFWmh8WvVV8sXcC7Snm1OFoozyhdd67PfHPXT43NLCtZZ48v3DiQbcg3glcaObbGuPkiZfBitG5LHDaph2mF5LOAiYH_gZNUhwlbR5hkZpKTWbEtYu-ERfYqKBeChcth-F1yATWjV117F_sZGYY9jUS8bofl_I6f62f5uM Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Project-Id: 468e9932c7634b0d8c3257ee14a66959 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/468e9932c7634b0d8c3257ee14a66959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Tenant-Id: 468e9932c7634b0d8c3257ee14a66959 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434579998 Apr 12 07:53:48 user devstack@n-api.service[72696]: X-User: tempest-VolumesSnapshotTestJSON-1434579998-project-member Apr 12 07:53:48 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:53:48 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:53:48 user devstack@n-api.service[72696]: X-User-Id: 76d4eef76f634fb39c1f0895abfbd17d Apr 12 07:53:48 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434579998-project-member Apr 12 07:53:48 user devstack@n-api.service[72696]: method: > Apr 12 07:53:48 user devstack@n-api.service[72696]: exception: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. Apr 12 07:53:48 user devstack@n-api.service[72696]: action_args: {'id': 'c33e7825-1766-472a-8f09-c17a239fe63b'} Apr 12 07:53:48 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. Apr 12 07:53:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:53:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] Returning 404 to user: Instance c33e7825-1766-472a-8f09-c17a239fe63b could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:53:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f2a3b56d-f696-4f9a-b7cf-7d2cc9609048 tempest-VolumesSnapshotTestJSON-1434579998 tempest-VolumesSnapshotTestJSON-1434579998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b" status: 404 len: 111 microversion: 2.1 time: 0.046701 Apr 12 07:53:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 234/701] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:48 2023] GET /compute/v2.1/servers/c33e7825-1766-472a-8f09-c17a239fe63b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:53:49 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "name": "network-vif-plugged", "status": "completed", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:49 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] Creating event network-vif-plugged:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 07:53:49 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-89f33609-ae48-4d40-bed2-3b3f6f2c2874 req-3aaeda1b-eaed-4473-a103-a4e70cb72670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080445 Apr 12 07:53:49 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 235/702] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "name": "network-vif-plugged", "status": "completed", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:51 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] Creating event network-vif-plugged:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 07:53:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-9a039f2d-dd45-47b8-8336-87cde74485a2 req-b34c2733-4b35-48f3-bd65-950afd8307a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028978 Apr 12 07:53:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 234/703] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1973938028", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "c16bc06c-152b-4927-af6e-83ea43e8913e"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] validate_networks() for [('c16bc06c-152b-4927-af6e-83ea43e8913e', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting quotas for project a1fd2e19a7d6462fbcfb1e4e7d46ac36. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting quotas for user 0758a81ac62548b1b39ab0487835c360 and project a1fd2e19a7d6462fbcfb1e4e7d46ac36. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:53:52 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:53:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e8fcde19-ca65-4a3e-820a-a52eca0f1a0e tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.562870 Apr 12 07:53:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 235/704] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:53:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:53:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6e890387-b62f-49f5-8817-eead273e1033 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:53:53 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-6e890387-b62f-49f5-8817-eead273e1033 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:53:53 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-6e890387-b62f-49f5-8817-eead273e1033 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:53:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6e890387-b62f-49f5-8817-eead273e1033 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43" status: 200 len: 1208 microversion: 2.1 time: 0.072829 Apr 12 07:53:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 236/705] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:53:53 2023] GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 => generated 1208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=17 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:55 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] Creating event network-changed:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:53:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f756ed79-a5af-42e3-a12f-281cb3743454 req-fd095218-d451-4637-a502-bb5ec1ed1d16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036251 Apr 12 07:53:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 235/706] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "name": "network-vif-plugged", "status": "completed", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=31 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] Creating event network-vif-plugged:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:53:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-dd6364e5-b96a-4e2b-80e7-1a7d6fde6516 req-e293091f-d789-4361-9815-6b6789d494da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039328 Apr 12 07:53:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 236/707] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "name": "network-vif-plugged", "status": "completed", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=25 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:53:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:53:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] Creating event network-vif-plugged:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:53:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-157f89ab-ae82-4e00-b4ce-f105856c7b5a req-da3e6437-5a0b-4b22-9893-7c049290e7a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049033 Apr 12 07:53:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 237/708] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:53:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-0c282049-0801-4608-b233-e2b839cbf2b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102693 Apr 12 07:54:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:54:15 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=12 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HTTP exception thrown: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 is not attached to volume 957dad42-1b5b-4347-b512-2459774d09f4 Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Request method failure captured: Apr 12 07:54:15 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments/957dad42-1b5b-4347-b512-2459774d09f4 HTTP/1.1 Apr 12 07:54:15 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:54:15 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:54:15 user devstack@n-api.service[72696]: Connection: close Apr 12 07:54:15 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:54:15 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:54:15 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:54:15 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:54:15 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmJ5ao-WRAXy0VExSi6xSlZHm91MPS2bCNobtXwmgm4g181xmsxShJlDalRCOhg2SJ_9LMiZjZnmPry69nkeoO8UkUIHPM-QZ_qv4MbTv_Mt7lPD_zuFnA6JJZ31hkRn5GoigmJejJiilWYgQyqtHJo1Dgu8o_leo4mPAG-QGwPmQOQ Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Project-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Tenant: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Tenant-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-User: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:54:15 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:54:15 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:54:15 user devstack@n-api.service[72696]: X-User-Id: 630f8381d3534fd3a1978fc0a931e8c0 Apr 12 07:54:15 user devstack@n-api.service[72696]: X-User-Name: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:54:15 user devstack@n-api.service[72696]: method: > Apr 12 07:54:15 user devstack@n-api.service[72696]: exception: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 is not attached to volume 957dad42-1b5b-4347-b512-2459774d09f4 Apr 12 07:54:15 user devstack@n-api.service[72696]: action_args: {'server_id': '40c8d6d7-d840-4417-b897-92ff8258d984', 'id': '957dad42-1b5b-4347-b512-2459774d09f4'} Apr 12 07:54:15 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 957dad42-1b5b-4347-b512-2459774d09f4. Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 is not attached to volume 957dad42-1b5b-4347-b512-2459774d09f4 Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 is not attached to volume 957dad42-1b5b-4347-b512-2459774d09f4 Apr 12 07:54:15 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:54:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Returning 404 to user: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 is not attached to volume 957dad42-1b5b-4347-b512-2459774d09f4 {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:54:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-135ab7a4-b80f-411f-adab-12176105657e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments/957dad42-1b5b-4347-b512-2459774d09f4" status: 404 len: 154 microversion: 2.1 time: 0.116052 Apr 12 07:54:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:54:15 2023] DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984/os-volume_attachments/957dad42-1b5b-4347-b512-2459774d09f4 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:18 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:54:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0aaa1389-1607-43f0-b375-7a80f89da47e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 204 len: 0 microversion: 2.1 time: 0.118697 Apr 12 07:54:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 238/711] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:54:18 2023] DELETE /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:19 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-da7e1ece-a81f-41cd-b2fd-9335ec8597d0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 200 len: 1540 microversion: 2.1 time: 0.221223 Apr 12 07:54:19 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:19 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 1540 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:19 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-unplugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:19 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:19 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:19 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:19 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] Creating event network-vif-unplugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:54:19 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-b99a78c2-bac1-4c4c-8bf8-9d6e163e8d3a req-8dee9582-d322-45dd-9162-eea9fd1985b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033056 Apr 12 07:54:19 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 238/713] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-deleted", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] Creating event network-vif-deleted:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:54:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a73a2882-c599-4e4d-9eb6-e727da2710e3 req-270b6415-6384-4ce8-9db0-e7fcd15e27fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047852 Apr 12 07:54:20 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 239/714] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c8d6d7-d840-4417-b897-92ff8258d984", "name": "network-vif-plugged", "status": "completed", "tag": "8c395303-b043-4eef-a6ac-e567893e6de4"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] Creating event network-vif-plugged:8c395303-b043-4eef-a6ac-e567893e6de4 for instance 40c8d6d7-d840-4417-b897-92ff8258d984 on user Apr 12 07:54:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-0ec30bb6-d88a-417f-9db2-bbf558d3c779 req-2babd0da-a41f-405f-8bfc-ebb31b34c6fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Apr 12 07:54:21 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 238/715] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3ba74cef-af33-4fb9-b248-7c153a89dbe2 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1768 microversion: 2.87 time: 0.151519 Apr 12 07:54:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 239/716] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:54:22 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1768 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:25 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b6c46302-5f73-4e3f-9765-6bde558bf810 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 200 len: 1441 microversion: 2.1 time: 0.165996 Apr 12 07:54:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 240/717] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:25 2023] GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-243f018f-4489-49e2-8294-7f1c00c1f158 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048372 Apr 12 07:54:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 239/718] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:54:26 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:26 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:54:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-cda5b831-936a-48e6-9981-58162cfb7831 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 204 len: 0 microversion: 2.1 time: 0.130539 Apr 12 07:54:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:54:26 2023] DELETE /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] Creating event network-changed:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:54:27 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-69a16b63-c4a2-44cd-81a3-7b7b18b629d4 req-acc9639b-5188-4c8e-a20e-d860a910b5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 Apr 12 07:54:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 240/720] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cd26fe26-fde7-455f-a684-e5fe42167ab9 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 200 len: 1674 microversion: 2.1 time: 0.236916 Apr 12 07:54:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 241/721] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:27 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-unplugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] Creating event network-vif-unplugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:54:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-ff04b602-fb99-4e13-8143-c93a28eb196c req-c1680440-58bc-4497-96a9-f6abf3e33c5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035545 Apr 12 07:54:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 241/722] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-deleted", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] Creating event network-vif-deleted:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:54:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-993ede09-f51c-4a65-bb9f-913f6dc43328 req-b81a0a99-c0d1-4ad1-8c32-4b56d9c9aed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030516 Apr 12 07:54:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 241/723] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d96b11f-6cb6-4d16-acd3-94f7ae0c2350", "name": "network-vif-plugged", "status": "completed", "tag": "2805f98a-2ed0-4f69-b952-25ebe25cf704"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] Creating event network-vif-plugged:2805f98a-2ed0-4f69-b952-25ebe25cf704 for instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 on user Apr 12 07:54:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-b19d82b2-4487-4c79-8fe6-1a2dfba9bdcc req-d7b7816a-1629-449e-9a6b-b612a3336193 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Apr 12 07:54:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 242/724] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:32 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-850084019", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1580615295", "security_groups": [{"name": "tempest-secgroup-smoke-278447882"}], "block_device_mapping_v2": [{"uuid": "0b434b43-ce87-4cac-96e7-642f1686222b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75249366-198a-45a1-8aa1-05694b14476d"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:32 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] validate_networks() for [('75249366-198a-45a1-8aa1-05694b14476d', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Getting quotas for user 71763ade39bb43eb947ea6f175ce68c1 and project 145931c86ba9489684b6eabb936b9738. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:54:33 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b434b43-ce87-4cac-96e7-642f1686222b',volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:54:33 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-62d3b3f2-dfdf-451b-ba1a-35ead1ec1289 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.822621 Apr 12 07:54:33 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 242/725] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:54:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:54:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-730a125c-672f-4f9e-983d-a312eec39885 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:33 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-730a125c-672f-4f9e-983d-a312eec39885 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:33 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-730a125c-672f-4f9e-983d-a312eec39885 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-730a125c-672f-4f9e-983d-a312eec39885 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 200 len: 1089 microversion: 2.1 time: 0.118838 Apr 12 07:54:33 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 242/726] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:33 2023] GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 1089 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:34 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:34 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fd7cc9e9-eade-4de8-ad68-a2c9093034a2 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 200 len: 1538 microversion: 2.1 time: 0.252895 Apr 12 07:54:34 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 243/727] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:34 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 1538 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:35 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] Creating event network-changed:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:54:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0c4427dd-853a-4147-a73b-0780cb532ae9 req-c5f2d421-a95f-45cb-bd0d-ec408959b5a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033290 Apr 12 07:54:35 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 243/728] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "name": "network-vif-plugged", "status": "completed", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:41 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=25 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] Creating event network-vif-plugged:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:54:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-b350c55d-da03-4376-bf83-9054e2582e1a req-5a1b1134-26af-41d8-b9a3-72904e7ce2ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038453 Apr 12 07:54:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 243/729] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:43 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:54:43 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d01d136d-5734-400a-b4b7-1832906bf463 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43" status: 200 len: 1486 microversion: 2.1 time: 0.141904 Apr 12 07:54:43 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 244/730] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:54:43 2023] GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 => generated 1486 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "name": "network-vif-plugged", "status": "completed", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:54:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:54:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] Creating event network-vif-plugged:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:54:43 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-4c66fd36-b7ad-49d1-831a-7a2ecb617e2e req-70c3fe02-b9e5-454c-ae5e-3b721c1c0b57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040201 Apr 12 07:54:43 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 244/731] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:54:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=18 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: 40c8d6d7-d840-4417-b897-92ff8258d984] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HTTP exception thrown: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Request method failure captured: Apr 12 07:55:09 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 HTTP/1.1 Apr 12 07:55:09 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:55:09 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:55:09 user devstack@n-api.service[72697]: Connection: close Apr 12 07:55:09 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:55:09 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:55:09 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:55:09 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:55:09 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmJ5ao-WRAXy0VExSi6xSlZHm91MPS2bCNobtXwmgm4g181xmsxShJlDalRCOhg2SJ_9LMiZjZnmPry69nkeoO8UkUIHPM-QZ_qv4MbTv_Mt7lPD_zuFnA6JJZ31hkRn5GoigmJejJiilWYgQyqtHJo1Dgu8o_leo4mPAG-QGwPmQOQ Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Project-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Tenant: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Tenant-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-User: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:55:09 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:55:09 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:55:09 user devstack@n-api.service[72697]: X-User-Id: 630f8381d3534fd3a1978fc0a931e8c0 Apr 12 07:55:09 user devstack@n-api.service[72697]: X-User-Name: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:55:09 user devstack@n-api.service[72697]: method: > Apr 12 07:55:09 user devstack@n-api.service[72697]: exception: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. Apr 12 07:55:09 user devstack@n-api.service[72697]: action_args: {'id': '40c8d6d7-d840-4417-b897-92ff8258d984'} Apr 12 07:55:09 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. Apr 12 07:55:09 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:55:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Returning 404 to user: Instance 40c8d6d7-d840-4417-b897-92ff8258d984 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:55:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-89767c38-9563-4e79-9ecc-1f97fc71ee87 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984" status: 404 len: 111 microversion: 2.1 time: 0.039056 Apr 12 07:55:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 244/732] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:09 2023] GET /compute/v2.1/servers/40c8d6d7-d840-4417-b897-92ff8258d984 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:55:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:09 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-bf88e492-1df7-415c-a9ca-e9b6db4b66f7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '.version_select at 0x7f7c051de3b0>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-bf88e492-1df7-415c-a9ca-e9b6db4b66f7 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-788402656" status: 202 len: 0 microversion: 2.1 time: 0.027945 Apr 12 07:55:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 12 07:55:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-788402656 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:55:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8d38ecdd-fd31-4e43-8f81-efe4e09738b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: .version_select at 0x7f7c05121f30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-623587583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsJMgKR2OtLfQZhgaJUVQq7Qz6EmW1x26YrHrFvEapwB9N+yzYyW5wym/7oCwnZlsj89EtVjI1kDh92fCOQewJ9CfY+dmGsR7zSXq+UfbqqLPcqsbhfRlDZHAL5iHXXsg=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:11 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-8d38ecdd-fd31-4e43-8f81-efe4e09738b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:55:11 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-8d38ecdd-fd31-4e43-8f81-efe4e09738b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for user 630f8381d3534fd3a1978fc0a931e8c0 and project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:55:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8d38ecdd-fd31-4e43-8f81-efe4e09738b3 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.106273 Apr 12 07:55:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 245/734] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 07:55:11 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1719272565", "imageRef": "27758478-87f6-46a9-8895-882f41f56ed8", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-623587583", "networks": [{"uuid": "8d582cc3-519c-40ba-ae13-e3410dd86c82"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:11 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] validate_networks() for [('8d582cc3-519c-40ba-ae13-e3410dd86c82', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Getting quotas for user 630f8381d3534fd3a1978fc0a931e8c0 and project 27f4f7b1930e48cb82f5f6010872e221. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:55:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27758478-87f6-46a9-8895-882f41f56ed8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:55:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-993bd6a9-8996-4736-98d5-8492b309cce0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.574602 Apr 12 07:55:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 245/735] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:55:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:55:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-62c08c66-2a34-49df-895b-7db57401e648 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-62c08c66-2a34-49df-895b-7db57401e648 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:12 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-62c08c66-2a34-49df-895b-7db57401e648 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-62c08c66-2a34-49df-895b-7db57401e648 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1252 microversion: 2.1 time: 0.128352 Apr 12 07:55:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 246/736] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:12 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1252 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:55:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] Creating event network-changed:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:55:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-965a77b7-46b6-4c4c-ad9d-6161742bcbb6 req-c447395e-f09a-48b4-94d8-75bf0b34fdca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106348 Apr 12 07:55:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 246/737] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:17 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:55:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-48846f0f-7007-46ba-ab95-881eea1da5a7 req-bfccbe83-575e-425a-b60f-bd452720250c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116458 Apr 12 07:55:17 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 246/738] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HTTP exception thrown: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Request method failure captured: Apr 12 07:55:17 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 HTTP/1.1 Apr 12 07:55:17 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:55:17 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:55:17 user devstack@n-api.service[72695]: Connection: close Apr 12 07:55:17 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:55:17 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:55:17 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:55:17 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:55:17 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmApYBd1x96NhnzxJC1QeMpG6tce--NfjqdsPkOw2y6gWWoQ8C_3EPX9bzMrl2ph-KqNy8ZAghfFDICMU0hTH3dj1hOtNVzkLDZuUyrPb1R52gIpQ6lGvfalxiEHQJA5t0cmosu42zOnqWapFOQ49Nx7O3mKM1ktuBpyvSwcAIVuP58 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Project-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Tenant-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:55:17 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-User: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:55:17 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:55:17 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:55:17 user devstack@n-api.service[72695]: X-User-Id: 86009132a34b466399da1701f47316d9 Apr 12 07:55:17 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:55:17 user devstack@n-api.service[72695]: method: > Apr 12 07:55:17 user devstack@n-api.service[72695]: exception: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. Apr 12 07:55:17 user devstack@n-api.service[72695]: action_args: {'id': '2d96b11f-6cb6-4d16-acd3-94f7ae0c2350'} Apr 12 07:55:17 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. Apr 12 07:55:17 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:55:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Returning 404 to user: Instance 2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:55:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-abe26f55-2a4e-4fe1-be31-0517b23085e0 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350" status: 404 len: 111 microversion: 2.1 time: 0.042646 Apr 12 07:55:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 247/739] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:17 2023] GET /compute/v2.1/servers/2d96b11f-6cb6-4d16-acd3-94f7ae0c2350 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:55:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e3846e53-6546-4fb0-9d09-97b4779ea965 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '.version_select at 0x7f7c0509f6d0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e3846e53-6546-4fb0-9d09-97b4779ea965 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-44620121" status: 202 len: 0 microversion: 2.1 time: 0.029082 Apr 12 07:55:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 247/740] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 07:55:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-44620121 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:55:19 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:55:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-8849b62a-f1a0-4c63-83a1-467366112129 req-56fd7aaa-1468-4537-8e50-8f79207b34bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045294 Apr 12 07:55:19 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 247/741] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:22 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:55:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0eccdfcf-86d0-4a15-96f6-9623a0ba98fa tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 204 len: 0 microversion: 2.1 time: 0.115345 Apr 12 07:55:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 248/742] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:55:22 2023] DELETE /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-5e23828e-6a86-449c-b63f-0a0769652e5e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 200 len: 1494 microversion: 2.1 time: 0.268089 Apr 12 07:55:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 248/743] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:22 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 1494 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-unplugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] Creating event network-vif-unplugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:55:23 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f5d8a130-60dc-4a85-8ef0-ec0037ed0819 req-d1a332f1-8e14-4a09-8889-14ee9b1a492d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093611 Apr 12 07:55:23 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 248/744] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-167399412", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "b8a83b38-0d35-47f7-9c68-5c0606d94c19"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] validate_networks() for [('b8a83b38-0d35-47f7-9c68-5c0606d94c19', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c5b0338e-04db-4b19-ac50-4299374ecae7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 200 len: 1442 microversion: 2.1 time: 0.202370 Apr 12 07:55:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 249/745] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:23 2023] GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 1442 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for user 2c01e1260cfa45f6b9d225592867f240 and project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:55:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:55:24 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ea57c9fd-6f32-426f-9e37-fbce2d6ae37e tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.770535 Apr 12 07:55:24 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 249/746] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 07:55:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:55:24 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:24 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:24 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:24 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:24 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a61c4cea-82c0-4d5d-9bdc-c76791e46967 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 200 len: 1394 microversion: 2.87 time: 0.066612 Apr 12 07:55:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 249/747] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:55:24 2023] GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 1394 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:55:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-deleted", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] Creating event network-vif-deleted:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:55:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-49c3c8f0-cb39-4759-af14-851f92ae94f0 req-0bf20f72-9277-47b3-95b9-12ba2b09305b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Apr 12 07:55:24 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 250/748] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:25 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbd6126-210b-41cf-a994-528233e5369b", "name": "network-vif-plugged", "status": "completed", "tag": "72eb7ca6-62de-4e4f-b40f-52343e160945"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:25 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] Creating event network-vif-plugged:72eb7ca6-62de-4e4f-b40f-52343e160945 for instance acbd6126-210b-41cf-a994-528233e5369b on user Apr 12 07:55:25 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-2d9f50b6-3570-44e3-8c45-c5f9e385fe5f req-2ff0426b-48b8-4e33-a913-7a679410ecb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041886 Apr 12 07:55:25 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] Creating event network-changed:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 07:55:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-06993571-ad32-498c-a880-3d9be35ebf8f req-9cf2d529-5b5e-4ae9-a459-a360f495e50b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036247 Apr 12 07:55:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 250/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "name": "network-vif-plugged", "status": "completed", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] Creating event network-vif-plugged:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 07:55:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-03951172-1173-4c79-8b81-0e448910785d req-bae22f3c-6694-4a60-8ce1-df796d62485b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Apr 12 07:55:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 251/751] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "name": "network-vif-plugged", "status": "completed", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] Creating event network-vif-plugged:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 07:55:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-03b471a2-7829-47f6-834e-6c8bef65d4a2 req-f51d2422-0034-46b1-b0d8-d49c4ccc1f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Apr 12 07:55:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 251/752] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-574bf561-607f-4a1f-b42e-20600b2a74e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.231672 Apr 12 07:55:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 251/753] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:55:35 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3/os-interface => generated 282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] Creating event network-changed:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 07:55:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-461a1a93-f171-4848-80e4-d077775108ed req-d76a1517-c996-41ba-9e1b-0b57f4f842aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Apr 12 07:55:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 252/754] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:38 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:38 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-453121416", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "af815a31-5dc3-45af-a83e-9a4374f8315f"}], "security_groups": [{"name": "tempest-securitygroup--119662826"}], "key_name": "tempest-keypair-562229555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e0211892-4d87-4d0d-98ee-515eb41bc65b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:38 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] validate_networks() for [('af815a31-5dc3-45af-a83e-9a4374f8315f', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0211892-4d87-4d0d-98ee-515eb41bc65b',volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:55:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9548804a-16ea-4ca9-8090-f2d72e774130 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.707445 Apr 12 07:55:39 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 252/755] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:55:38 2023] POST /compute/v2.1/servers => generated 403 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:55:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4b83dab8-e17f-4f9e-8df6-cfd9346b2972 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:39 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4b83dab8-e17f-4f9e-8df6-cfd9346b2972 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:39 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:39 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-4b83dab8-e17f-4f9e-8df6-cfd9346b2972 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4b83dab8-e17f-4f9e-8df6-cfd9346b2972 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1074 microversion: 2.1 time: 0.069863 Apr 12 07:55:39 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 252/756] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:39 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1074 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:42 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=21 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] Creating event network-changed:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:55:42 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-6258ab3a-368d-45de-9996-9ce5e6fb3c16 req-704a24db-8b13-48c2-aece-3a1b7e6a44cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Apr 12 07:55:42 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 253/757] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:43 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:55:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cba3a854-f225-4cd1-a8c6-d7cc4cb9002c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43" status: 204 len: 0 microversion: 2.1 time: 0.111054 Apr 12 07:55:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 253/758] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:55:43 2023] DELETE /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:55:44 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:55:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c235fce2-a5bc-4fd3-9d95-80b9df7f6341 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43" status: 200 len: 1492 microversion: 2.1 time: 0.189627 Apr 12 07:55:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 253/759] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:55:44 2023] GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 => generated 1492 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:55:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] Creating event network-vif-unplugged:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:55:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-76d08ec9-50f1-4abc-8d35-43c6abadcd58 req-d722ae91-70b6-4a13-9156-f9bba794fbdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031240 Apr 12 07:55:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "name": "network-vif-plugged", "status": "completed", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}, {"server_uuid": "611c996f-b32c-4d8f-86c5-b48e492c7d43", "name": "network-vif-deleted", "tag": "9a9860b6-35f6-4ce3-8509-6db0cd53c16e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Creating event network-vif-plugged:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:55:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] Creating event network-vif-deleted:9a9860b6-35f6-4ce3-8509-6db0cd53c16e for instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 on user Apr 12 07:55:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-2cd1bf39-c54e-460b-99cf-830df214ec5a req-41859291-32a0-4584-b5a0-e9cf174a9914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034066 Apr 12 07:55:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 254/761] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:55:48 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}, {"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:55:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:55:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:55:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:55:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:55:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:55:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f76c1f99-ab95-4657-9f02-a1ee38f2f12f req-f0e164ba-10a6-49d6-8964-8bebad1d4779 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030931 Apr 12 07:55:48 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 254/762] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:02 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-44f1b109-a29b-4d34-8663-8bf904aec40f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1535 microversion: 2.1 time: 0.175201 Apr 12 07:56:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 255/763] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:02 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: acbd6126-210b-41cf-a994-528233e5369b] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HTTP exception thrown: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Request method failure captured: Apr 12 07:56:13 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b HTTP/1.1 Apr 12 07:56:13 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:56:13 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:56:13 user devstack@n-api.service[72695]: Connection: close Apr 12 07:56:13 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:56:13 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:56:13 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:56:13 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:56:13 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmApYBd1x96NhnzxJC1QeMpG6tce--NfjqdsPkOw2y6gWWoQ8C_3EPX9bzMrl2ph-KqNy8ZAghfFDICMU0hTH3dj1hOtNVzkLDZuUyrPb1R52gIpQ6lGvfalxiEHQJA5t0cmosu42zOnqWapFOQ49Nx7O3mKM1ktuBpyvSwcAIVuP58 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Project-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Tenant-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:56:13 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-User: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:56:13 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:56:13 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:56:13 user devstack@n-api.service[72695]: X-User-Id: 86009132a34b466399da1701f47316d9 Apr 12 07:56:13 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:56:13 user devstack@n-api.service[72695]: method: > Apr 12 07:56:13 user devstack@n-api.service[72695]: exception: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. Apr 12 07:56:13 user devstack@n-api.service[72695]: action_args: {'id': 'acbd6126-210b-41cf-a994-528233e5369b'} Apr 12 07:56:13 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. Apr 12 07:56:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Returning 404 to user: Instance acbd6126-210b-41cf-a994-528233e5369b could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:56:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9df64a8b-0837-425f-bf2f-c359f1b5428e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b" status: 404 len: 111 microversion: 2.1 time: 0.150399 Apr 12 07:56:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:13 2023] GET /compute/v2.1/servers/acbd6126-210b-41cf-a994-528233e5369b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=7 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=7 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:56:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8d35050a-03f5-4868-b8a3-cdf02ff80449 tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 204 len: 0 microversion: 2.1 time: 0.190784 Apr 12 07:56:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 255/765] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:56:13 2023] DELETE /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=5 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86009132a34b466399da1701f47316d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1c96acdf1f46f4b660de199d2b852b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-27206729-d20b-4758-ae14-1326db60016e tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 200 len: 1508 microversion: 2.1 time: 0.167095 Apr 12 07:56:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:13 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-unplugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] Creating event network-vif-unplugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:56:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a7c343ac-45bd-47a4-9b58-959940851931 req-31171bef-b05b-44b8-876d-9092f0880077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031626 Apr 12 07:56:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 256/767] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-49176176-259b-411f-b985-df152727cc82 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 200 len: 1690 microversion: 2.87 time: 0.175013 Apr 12 07:56:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 256/768] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:56:14 2023] GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:56:14 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-deleted", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:14 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] Creating event network-vif-deleted:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:56:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0ccdff68-4b78-41e3-a785-e139ff0eff0a req-5f647e87-64b4-42b0-ab7f-d5108a7ae458 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039292 Apr 12 07:56:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 257/769] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2", "name": "network-vif-plugged", "status": "completed", "tag": "833dbd18-9190-4c45-8724-b57e1f46efcb"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] Creating event network-vif-plugged:833dbd18-9190-4c45-8724-b57e1f46efcb for instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 on user Apr 12 07:56:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-a0d199f3-9055-48b6-a92a-2a2aa6a31262 req-5145d898-a676-4880-a99f-45cf4e04cf7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037280 Apr 12 07:56:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 257/770] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:23 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:24 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:24 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-5168ab23-6248-4856-ac39-bab410dd3f33 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 200 len: 1442 microversion: 2.1 time: 0.150356 Apr 12 07:56:24 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 257/771] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:23 2023] GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] Creating event network-changed:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:56:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-d80c8eff-38a1-4356-80fa-df874ca11f2d req-ecdfb437-a7f8-4046-a6f6-a8fca08a0400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041707 Apr 12 07:56:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 258/772] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:56:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f057d33a-dc4d-4ee2-9cf7-1e1e674bb3f7 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 204 len: 0 microversion: 2.1 time: 0.131295 Apr 12 07:56:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 258/773] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:56:26 2023] DELETE /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c5bf8a2a-030a-40d6-9008-946074bfcdb9 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 200 len: 1567 microversion: 2.1 time: 0.151157 Apr 12 07:56:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 258/774] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:26 2023] GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}, {"server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}, {"server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "name": "network-vif-plugged", "status": "completed", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Creating event network-changed:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:56:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Creating event network-vif-unplugged:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:56:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] Creating event network-vif-plugged:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:56:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-34a24213-5369-4a13-8118-3838b5694537 req-06c55631-65d3-40aa-9354-3bc3ca7c00a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.034447 Apr 12 07:56:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 259/775] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137c8fe9-a53f-4d00-84ed-63df965d3cb9", "name": "network-vif-deleted", "tag": "cc999de7-d108-42bc-a880-e680f48b60c1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] Creating event network-vif-deleted:cc999de7-d108-42bc-a880-e680f48b60c1 for instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 on user Apr 12 07:56:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fcabb650-3d0b-47a5-a9eb-2b90408ab7e9 req-06815e00-271e-4f75-8729-12e5b11246cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030419 Apr 12 07:56:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 259/776] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:29 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-688d565a-e664-48d5-8b3b-8bd26dfebaa8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1427 microversion: 2.1 time: 0.230216 Apr 12 07:56:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 259/777] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:29 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1427 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: 611c996f-b32c-4d8f-86c5-b48e492c7d43] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] HTTP exception thrown: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Request method failure captured: Apr 12 07:56:34 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 HTTP/1.1 Apr 12 07:56:34 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:56:34 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:56:34 user devstack@n-api.service[72696]: Connection: close Apr 12 07:56:34 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:56:34 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:56:34 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:56:34 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:56:34 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmOOwRbuWmkpMe9Mgd7PQhiqjAp6utQJvB0gE1SijTxYzylVLQ9yYPQ5EqzwUwZsP7s2EaeUPTa3aNts45UQ4mdClUfgjX2wmUqBTyftFjyAEu6YCrmEwnm-Asb41pR-CQBn8Junb-lt_0Vg1wa1RoqFZYZYLe21bo-7hp5cdqANCEQ Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Project-Id: a1fd2e19a7d6462fbcfb1e4e7d46ac36 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesActionsTest-236815586 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesActionsTest-236815586 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Tenant-Id: a1fd2e19a7d6462fbcfb1e4e7d46ac36 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesActionsTest-236815586 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-User: tempest-VolumesActionsTest-236815586-project-member Apr 12 07:56:34 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:56:34 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:56:34 user devstack@n-api.service[72696]: X-User-Id: 0758a81ac62548b1b39ab0487835c360 Apr 12 07:56:34 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesActionsTest-236815586-project-member Apr 12 07:56:34 user devstack@n-api.service[72696]: method: > Apr 12 07:56:34 user devstack@n-api.service[72696]: exception: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. Apr 12 07:56:34 user devstack@n-api.service[72696]: action_args: {'id': '611c996f-b32c-4d8f-86c5-b48e492c7d43'} Apr 12 07:56:34 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. Apr 12 07:56:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:56:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Returning 404 to user: Instance 611c996f-b32c-4d8f-86c5-b48e492c7d43 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:56:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-67ecac62-ba84-47ca-b746-75b1fa84d9ec tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43" status: 404 len: 111 microversion: 2.1 time: 0.032226 Apr 12 07:56:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 260/778] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:34 2023] GET /compute/v2.1/servers/611c996f-b32c-4d8f-86c5-b48e492c7d43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1612090880", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "c16bc06c-152b-4927-af6e-83ea43e8913e"}]}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] validate_networks() for [('c16bc06c-152b-4927-af6e-83ea43e8913e', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting quotas for project a1fd2e19a7d6462fbcfb1e4e7d46ac36. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Getting quotas for user 0758a81ac62548b1b39ab0487835c360 and project a1fd2e19a7d6462fbcfb1e4e7d46ac36. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:56:34 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:56:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-450eea00-b789-495b-8578-aed98fbfa5d2 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.507734 Apr 12 07:56:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 260/779] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:56:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:56:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e193f19e-3ce8-4c12-88a3-575511c8eb48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:56:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e193f19e-3ce8-4c12-88a3-575511c8eb48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:56:35 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-e193f19e-3ce8-4c12-88a3-575511c8eb48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:56:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e193f19e-3ce8-4c12-88a3-575511c8eb48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" status: 200 len: 1208 microversion: 2.1 time: 0.061213 Apr 12 07:56:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 260/780] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:56:35 2023] GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => generated 1208 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:56:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] Creating event network-changed:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:56:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-3a15e223-4744-453c-9438-5f78b64e94c4 req-0276239d-a79b-49fb-8923-e12464c7717c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036273 Apr 12 07:56:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 261/781] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:39 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "name": "network-vif-plugged", "status": "completed", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] Creating event network-vif-plugged:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:56:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-dd745c3b-0a05-4bc6-8424-686973030850 req-9ca5ed4f-35ef-4142-8948-211ffb4610fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027444 Apr 12 07:56:39 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 261/782] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:56:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "name": "network-vif-plugged", "status": "completed", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:56:41 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:56:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:56:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:56:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:56:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] Creating event network-vif-plugged:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:56:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-65ed8be4-6a5d-4cac-9aa7-dabb282b44a0 req-4b8a332e-cd0b-4e59-96e7-b2ca0a0c0467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038270 Apr 12 07:56:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 261/783] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:56:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:02 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0cf8ce35-3411-4f5e-90eb-e84182be9cf1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1535 microversion: 2.1 time: 0.149397 Apr 12 07:57:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 262/784] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:02 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1535 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Searching by: {'deleted': False, 'project_id': '27f4f7b1930e48cb82f5f6010872e221'} {{(pid=72695) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:03 user devstack@n-api.service[72695]: DEBUG nova.compute.multi_cell_list [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72695) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 07:57:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-23f40a5d-b3d2-4b67-b595-4f5374e14dee tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.073162 Apr 12 07:57:03 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 262/785] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 07:57:02 2023] GET /compute/v2.1/servers => generated 341 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:03 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-02320801-dda6-497e-a4c1-7716037aa79b tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1535 microversion: 2.1 time: 0.148084 Apr 12 07:57:03 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 262/786] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:03 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1535 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] [instance: e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] HTTP exception thrown: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Request method failure captured: Apr 12 07:57:03 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 HTTP/1.1 Apr 12 07:57:03 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:57:03 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:57:03 user devstack@n-api.service[72696]: Connection: close Apr 12 07:57:03 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:57:03 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:57:03 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:57:03 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:57:03 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmApYBd1x96NhnzxJC1QeMpG6tce--NfjqdsPkOw2y6gWWoQ8C_3EPX9bzMrl2ph-KqNy8ZAghfFDICMU0hTH3dj1hOtNVzkLDZuUyrPb1R52gIpQ6lGvfalxiEHQJA5t0cmosu42zOnqWapFOQ49Nx7O3mKM1ktuBpyvSwcAIVuP58 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Project-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2b1c96acdf1f46f4b660de199d2b852b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Tenant-Id: 2b1c96acdf1f46f4b660de199d2b852b Apr 12 07:57:03 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884068301 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-User: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:57:03 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:57:03 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:57:03 user devstack@n-api.service[72696]: X-User-Id: 86009132a34b466399da1701f47316d9 Apr 12 07:57:03 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884068301-project-member Apr 12 07:57:03 user devstack@n-api.service[72696]: method: > Apr 12 07:57:03 user devstack@n-api.service[72696]: exception: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. Apr 12 07:57:03 user devstack@n-api.service[72696]: action_args: {'id': 'e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2'} Apr 12 07:57:03 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. Apr 12 07:57:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] Returning 404 to user: Instance e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:57:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-bbfeb55c-d854-475b-b54e-ae043588bb2d tempest-ServerRescueNegativeTestJSON-1884068301 tempest-ServerRescueNegativeTestJSON-1884068301-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2" status: 404 len: 111 microversion: 2.1 time: 0.034913 Apr 12 07:57:03 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 263/787] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:03 2023] GET /compute/v2.1/servers/e4ed2b1f-7fcb-4e37-bf32-c9a00fec53d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a3299e9-bd95-4ab4-9424-716b655b0b2f"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-e580ca0e-5c67-4858-9e44-56b7ba4c62ea tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287791 Apr 12 07:57:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 263/788] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 07:57:04 2023] POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:11 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-5f44b811-3628-4056-b2d7-12043927bf3e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1581 microversion: 2.1 time: 0.142423 Apr 12 07:57:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 263/789] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:11 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1581 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] Creating event network-changed:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-3ded4e8c-828c-41e3-b157-97c8e986b1cd req-607c1070-69e0-4e22-b899-0964f8e333e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039865 Apr 12 07:57:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 264/790] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1507818374"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-814131926"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ec966195-230c-4f9b-8c6c-633b25d4a970 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8/action" status: 202 len: 52 microversion: 2.87 time: 0.851658 Apr 12 07:57:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 264/791] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 07:57:14 2023] POST /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8/action => generated 52 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 07:57:15 user devstack@n-api.service[72697]: INFO nova.network.security_group_api [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Adding security group 748308d8-d8a9-4ed2-b933-a0c0fcdc6d18 to port 277f41f9-00ba-4f58-9186-da42879de40e Apr 12 07:57:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-96a6cd15-e5d3-4077-950e-393ac7706bcb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action" status: 202 len: 0 microversion: 2.1 time: 0.651717 Apr 12 07:57:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 264/792] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:57:15 2023] POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] Creating event network-changed:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-4b576a22-ab66-4036-9d3d-49b35a246aa9 req-793fe264-0f55-4287-9bf1-e27de95656c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027937 Apr 12 07:57:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:16 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-629a2163-14d0-4052-9223-fb8c75fa5354 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1745 microversion: 2.1 time: 0.235718 Apr 12 07:57:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 265/794] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:15 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1745 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d5859a1b-df97-4632-8d65-ee77c56d040e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action" status: 202 len: 0 microversion: 2.1 time: 0.135966 Apr 12 07:57:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 265/795] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:57:16 2023] POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:16 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1b825158-04dd-48d6-8077-0bdfd4b275c1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1737 microversion: 2.1 time: 0.182929 Apr 12 07:57:16 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 266/796] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:16 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 137c8fe9-a53f-4d00-84ed-63df965d3cb9] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:57:17 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 HTTP/1.1 Apr 12 07:57:17 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:57:17 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:57:17 user devstack@n-api.service[72696]: Connection: close Apr 12 07:57:17 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:57:17 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:57:17 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:57:17 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:57:17 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:57:17 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:57:17 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:57:17 user devstack@n-api.service[72696]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:57:17 user devstack@n-api.service[72696]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:57:17 user devstack@n-api.service[72696]: method: > Apr 12 07:57:17 user devstack@n-api.service[72696]: exception: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. Apr 12 07:57:17 user devstack@n-api.service[72696]: action_args: {'id': '137c8fe9-a53f-4d00-84ed-63df965d3cb9'} Apr 12 07:57:17 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. Apr 12 07:57:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:57:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 137c8fe9-a53f-4d00-84ed-63df965d3cb9 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:57:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d9459880-e6c9-48dc-b1bf-8441f8ca9d37 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9" status: 404 len: 111 microversion: 2.1 time: 0.297484 Apr 12 07:57:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 266/797] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:17 2023] GET /compute/v2.1/servers/137c8fe9-a53f-4d00-84ed-63df965d3cb9 => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:57:19 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-unplugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:19 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] Creating event network-vif-unplugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:19 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-471dd09a-1685-4783-8bf6-aae9824c3e70 req-03b16579-89bc-4a64-9719-bcafb8558a5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034749 Apr 12 07:57:19 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 266/798] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:20 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-15c5ccd0-af80-45f3-b95b-3609d8e9d901 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 200 len: 1690 microversion: 2.87 time: 0.400789 Apr 12 07:57:20 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 267/799] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:57:20 2023] GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 1690 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:57:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-202a22dc-fd7b-4818-be3e-8eba8341d9d3 req-78257ebe-eb6b-4695-acda-6da9938884b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045974 Apr 12 07:57:21 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 267/800] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] Creating event network-changed:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:57:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-44b201fd-62cc-4347-87b1-573a7b42d869 req-8b166023-44fc-4dd8-b4ee-c7670bbdb7eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034031 Apr 12 07:57:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 268/801] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:57:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-faad7515-2e25-48b0-909d-0e9d6df92492 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 204 len: 0 microversion: 2.1 time: 0.133150 Apr 12 07:57:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 267/802] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:57:22 2023] DELETE /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:22 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71763ade39bb43eb947ea6f175ce68c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145931c86ba9489684b6eabb936b9738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d0f40a14-a8c6-4452-a39f-6f23298a2b5a tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 200 len: 1566 microversion: 2.1 time: 0.294763 Apr 12 07:57:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 268/803] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:22 2023] GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}, {"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}, {"server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "name": "network-vif-unplugged", "status": "completed", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}, {"server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "name": "network-vif-plugged", "status": "completed", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:57:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Creating event network-vif-unplugged:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:57:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] Creating event network-vif-plugged:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:57:23 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-5394706a-8e23-487f-a5f4-603958824b25 req-7ddd3ab5-e92d-4b4e-aac2-c7b623982e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.045216 Apr 12 07:57:23 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 269/804] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:25 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:25 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a18c385f-2e66-409e-a2ea-30ef98361e63 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" status: 200 len: 1486 microversion: 2.1 time: 0.204222 Apr 12 07:57:25 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 268/805] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:25 2023] GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => generated 1486 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:25 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d2d38-c98a-45d2-8829-e95e7cac030e", "name": "network-vif-deleted", "tag": "7406406c-e3a5-4cf8-9cd4-3352be7a2f09"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:25 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] Creating event network-vif-deleted:7406406c-e3a5-4cf8-9cd4-3352be7a2f09 for instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e on user Apr 12 07:57:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-5af2374d-2fcf-438b-86ab-db1e625543b7 req-05ab340b-8890-4dc5-9170-7f835ca8cb03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Apr 12 07:57:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 269/806] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a881057c-bb47-4a5f-9fe1-8dc47ee893c3 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.189172 Apr 12 07:57:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 270/807] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 07:57:29 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/os-interface => generated 283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] Creating event network-changed:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 07:57:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6bab786b-7ea4-4f6b-be61-dd27bf2c68a8 req-14281326-a22a-4b3d-96c9-099d442ddafd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035914 Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:31 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 269/808] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-473c7607-f8cc-4a8d-9277-e80178837cae tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1427 microversion: 2.1 time: 0.285033 Apr 12 07:57:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 270/809] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:31 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1427 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Old instance type m1.nano, new instance type m1.micro {{(pid=72695) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Getting quotas for user c21b45cf78564f5092726eaeac38675e and project 1e0323c8eafc4012883daccef045d4a5. Resources: {'ram', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:57:31 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:57:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ff5f4989-a3d9-4720-917a-58fd47d05a97 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action" status: 202 len: 0 microversion: 2.1 time: 0.503754 Apr 12 07:57:31 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 271/810] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:57:31 2023] POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:32 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:57:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-087e3b86-1c63-459b-8b60-a30170441e85 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1436 microversion: 2.1 time: 0.238053 Apr 12 07:57:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 270/811] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:57:31 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1436 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:57:33 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:33 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:33 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] Creating event network-changed:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:57:33 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c290db66-26db-4975-b645-b8d5717ae554 req-e9fa9f32-9ab7-405d-bdc7-61ec3cec8db6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032437 Apr 12 07:57:33 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 271/812] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-unplugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}, {"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=35 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Creating event network-vif-unplugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:57:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:57:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] Instance a2485039-dabb-4fd6-85a3-2053001139e4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72695) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:57:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3461153c-e376-41ae-9154-7b3cfd123e96 req-6fa5061f-b33d-4507-80f9-cfa21a87899d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046683 Apr 12 07:57:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 272/813] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:57:44 user devstack@n-api.service[72697]: DEBUG nova.compute.api [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] Instance a2485039-dabb-4fd6-85a3-2053001139e4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:57:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-e3c7644a-70a4-458c-8dd8-6a45968e79ab req-2cfa3503-c90e-4a7e-bc61-df121397ae92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074880 Apr 12 07:57:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 271/814] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=16 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=28 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:57:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 07:57:46 user devstack@n-api.service[72696]: DEBUG nova.compute.api [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] Instance a2485039-dabb-4fd6-85a3-2053001139e4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72696) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 07:57:46 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-4f9ce3bc-9203-4e86-a4f6-5b9c39228837 req-6334a330-8a47-4364-8764-c9b75dc8ca5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045300 Apr 12 07:57:46 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 272/815] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:06 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:06 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d1fa1b02-3ae1-46a8-820c-cc35f303da06 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1745 microversion: 2.1 time: 0.182827 Apr 12 07:58:06 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 273/816] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:58:06 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 6f8d2d38-c98a-45d2-8829-e95e7cac030e] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. Apr 12 07:58:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:58:13 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e HTTP/1.1 Apr 12 07:58:13 user devstack@n-api.service[72697]: Accept: application/json Apr 12 07:58:13 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 07:58:13 user devstack@n-api.service[72697]: Connection: close Apr 12 07:58:13 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 07:58:13 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 07:58:13 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 07:58:13 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 07:58:13 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72697]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:58:13 user devstack@n-api.service[72697]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72697]: method: > Apr 12 07:58:13 user devstack@n-api.service[72697]: exception: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. Apr 12 07:58:13 user devstack@n-api.service[72697]: action_args: {'id': '6f8d2d38-c98a-45d2-8829-e95e7cac030e'} Apr 12 07:58:13 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. Apr 12 07:58:13 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 6f8d2d38-c98a-45d2-8829-e95e7cac030e could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:58:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e7c9059f-5158-4a7f-bc23-1c3d35f14eac tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e" status: 404 len: 111 microversion: 2.1 time: 0.283001 Apr 12 07:58:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:58:12 2023] GET /compute/v2.1/servers/6f8d2d38-c98a-45d2-8829-e95e7cac030e => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:58:13 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb HTTP/1.1 Apr 12 07:58:13 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:58:13 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:58:13 user devstack@n-api.service[72696]: Connection: close Apr 12 07:58:13 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:58:13 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:58:13 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:58:13 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:58:13 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72696]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:58:13 user devstack@n-api.service[72696]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72696]: method: > Apr 12 07:58:13 user devstack@n-api.service[72696]: exception: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72696]: action_args: {'id': '53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb'} Apr 12 07:58:13 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:58:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-9ae86cfa-e91a-47b2-8959-072ab8eb4798 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 404 len: 111 microversion: 2.1 time: 0.033156 Apr 12 07:58:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 273/818] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:58:13 2023] DELETE /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] [instance: 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] HTTP exception thrown: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Request method failure captured: Apr 12 07:58:13 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb HTTP/1.1 Apr 12 07:58:13 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:58:13 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:58:13 user devstack@n-api.service[72695]: Connection: close Apr 12 07:58:13 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:58:13 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:58:13 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:58:13 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:58:13 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmCUIvjNYTsxiaE7_L_AAi7oQhrDbfJdLpUvgVlmWPXuDJggV34lq3jykT2bt1xIh7kUJRFXBwJ8YmrqUcX29-0C54LkwynLAe3agsAkrsTEoy29V4VeaeH9kmQJOob9nw3JPoC4xo6RvNpvCEPpB8nPI8O0i-1p7pHCdZyeJLQ0xfQ Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Project-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/145931c86ba9489684b6eabb936b9738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/145931c86ba9489684b6eabb936b9738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Tenant: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Tenant-Id: 145931c86ba9489684b6eabb936b9738 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestVolumeBootPattern-11493924 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-User: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:58:13 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:58:13 user devstack@n-api.service[72695]: X-User-Id: 71763ade39bb43eb947ea6f175ce68c1 Apr 12 07:58:13 user devstack@n-api.service[72695]: X-User-Name: tempest-TestVolumeBootPattern-11493924-project-member Apr 12 07:58:13 user devstack@n-api.service[72695]: method: > Apr 12 07:58:13 user devstack@n-api.service[72695]: exception: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72695]: action_args: {'id': '53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb'} Apr 12 07:58:13 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. Apr 12 07:58:13 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:58:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Returning 404 to user: Instance 53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:58:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-13c6a837-4060-42c3-989c-4a890e4daac5 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb" status: 404 len: 111 microversion: 2.1 time: 0.031078 Apr 12 07:58:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 274/819] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:58:13 2023] GET /compute/v2.1/servers/53a04c1b-c3ec-4aa3-b3ca-e2681ad36aeb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 07:58:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e5ea1dee-7953-4cd9-9a8d-509581368ff4 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] Calling method '.version_select at 0x7f7bf47c39a0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e5ea1dee-7953-4cd9-9a8d-509581368ff4 tempest-TestVolumeBootPattern-11493924 tempest-TestVolumeBootPattern-11493924-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580615295" status: 202 len: 0 microversion: 2.1 time: 0.023865 Apr 12 07:58:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 273/820] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 12 07:58:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1580615295 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-361817046", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "destination_type": "volume"}], "networks": [{"uuid": "b8a83b38-0d35-47f7-9c68-5c0606d94c19"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] validate_networks() for [('b8a83b38-0d35-47f7-9c68-5c0606d94c19', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Getting quotas for user 2c01e1260cfa45f6b9d225592867f240 and project db13f97452634fb888d949ed5382b6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:58:21 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:58:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-caaada6f-ff31-41f9-9cf6-2b3b2e9054e9 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.611251 Apr 12 07:58:21 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 274/821] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 07:58:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 07:58:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:21 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:21 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:21 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:21 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1dcc6d12-8d45-4761-b8e9-3af77e1180c7 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1394 microversion: 2.87 time: 0.083955 Apr 12 07:58:21 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 275/822] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:58:21 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:22 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4f96ab6a-dc15-43fc-bf29-7bfb65cf0b48 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1553 microversion: 2.1 time: 0.173184 Apr 12 07:58:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 274/823] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:58:22 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:58:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] Creating event network-changed:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 07:58:24 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-6fa74f81-26de-498f-b57f-2b85bf75d685 req-52d2cbdc-12bd-4169-b1bb-04a9eaf6af9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036690 Apr 12 07:58:24 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 275/824] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:58:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cec5496a-fae4-4f06-8aeb-9dd9250bba48 tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" status: 204 len: 0 microversion: 2.1 time: 0.118775 Apr 12 07:58:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 276/825] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:58:26 2023] DELETE /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0758a81ac62548b1b39ab0487835c360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fd2e19a7d6462fbcfb1e4e7d46ac36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:58:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f08ff595-aa09-4d4f-9c8a-04eab1c0f61c tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" status: 200 len: 1492 microversion: 2.1 time: 0.167777 Apr 12 07:58:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:58:26 2023] GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => generated 1492 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:58:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "name": "network-vif-unplugged", "status": "completed", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] Creating event network-vif-unplugged:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:58:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c2864ef6-d43f-4e9e-a7f8-9bc862e2a297 req-896a9ea5-eee1-490e-b265-fa46973c299d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035697 Apr 12 07:58:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 276/827] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "name": "network-vif-deleted", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] Creating event network-vif-deleted:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:58:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-30f33a58-277f-4797-bcb1-8f88ee571f23 req-747648ab-6546-4a30-a133-7d6bba0d2500 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 Apr 12 07:58:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 277/828] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd", "name": "network-vif-plugged", "status": "completed", "tag": "de07d79b-b05a-45d8-85ad-81cf9eb763d0"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] Creating event network-vif-plugged:de07d79b-b05a-45d8-85ad-81cf9eb763d0 for instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd on user Apr 12 07:58:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f90a6d25-68b3-4f9e-9ddc-558d27da88bf req-104ffecb-54af-4101-a98e-af8f1909b0ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032839 Apr 12 07:58:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 276/829] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 07:58:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-04546201-5149-4021-b77a-433a792d2c0a req-a46e1f30-76fb-4d95-8477-d236018ed69a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047448 Apr 12 07:58:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 277/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:58:39 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:58:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 07:58:39 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-47e2436d-06c4-49e2-91b7-d349c28e821e req-935e5e12-a20c-4d9e-a49f-d93e0138a715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048083 Apr 12 07:58:39 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 278/831] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=16 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-814131926"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:07 user devstack@n-api.service[72697]: INFO nova.network.security_group_api [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Removing security group 748308d8-d8a9-4ed2-b933-a0c0fcdc6d18 from port 277f41f9-00ba-4f58-9186-da42879de40e Apr 12 07:59:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-22721759-8020-4f43-909d-a5da88256a8c tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action" status: 202 len: 0 microversion: 2.1 time: 0.568408 Apr 12 07:59:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 277/832] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:59:06 2023] POST /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] Creating event network-changed:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:59:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-581612ae-02b9-4d44-ad66-1a6927dfd125 req-d45eed7c-03e0-4971-8ced-a0287f5d5506 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036574 Apr 12 07:59:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 278/833] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:08 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] Creating event network-changed:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 07:59:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-d53d7d05-1b78-419d-ac2b-7bf366fa0764 req-0a069727-cc2c-4611-af62-19dbf10f483e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030859 Apr 12 07:59:08 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 278/834] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:59:08 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lazy-loading 'services' on Instance uuid bc267429-544b-4145-b4d9-8c2947c8c104 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 07:59:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-3d9e0231-fb28-4204-b4fb-c96b800a4f5e tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments/3a3299e9-bd95-4ab4-9424-716b655b0b2f" status: 202 len: 0 microversion: 2.1 time: 0.165009 Apr 12 07:59:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 279/835] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:59:08 2023] DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments/3a3299e9-bd95-4ab4-9424-716b655b0b2f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:08 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8252d839-55e6-4542-b747-d2aeda78dc36 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057004 Apr 12 07:59:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 279/836] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:59:08 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:12 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:59:12 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:59:12 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:59:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b1f751de-e23c-4caa-97fc-6dea209b28c3 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1768 microversion: 2.87 time: 0.503065 Apr 12 07:59:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 279/837] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:59:11 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1768 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] [instance: b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] HTTP exception thrown: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Request method failure captured: Apr 12 07:59:16 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd HTTP/1.1 Apr 12 07:59:16 user devstack@n-api.service[72695]: Accept: application/json Apr 12 07:59:16 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 07:59:16 user devstack@n-api.service[72695]: Connection: close Apr 12 07:59:16 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 07:59:16 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 07:59:16 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 07:59:16 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 07:59:16 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmOOwRbuWmkpMe9Mgd7PQhiqjAp6utQJvB0gE1SijTxYzylVLQ9yYPQ5EqzwUwZsP7s2EaeUPTa3aNts45UQ4mdClUfgjX2wmUqBTyftFjyAEu6YCrmEwnm-Asb41pR-CQBn8Junb-lt_0Vg1wa1RoqFZYZYLe21bo-7hp5cdqANCEQ Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Project-Id: a1fd2e19a7d6462fbcfb1e4e7d46ac36 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesActionsTest-236815586 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1fd2e19a7d6462fbcfb1e4e7d46ac36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesActionsTest-236815586 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Tenant-Id: a1fd2e19a7d6462fbcfb1e4e7d46ac36 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesActionsTest-236815586 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-User: tempest-VolumesActionsTest-236815586-project-member Apr 12 07:59:16 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 07:59:16 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 07:59:16 user devstack@n-api.service[72695]: X-User-Id: 0758a81ac62548b1b39ab0487835c360 Apr 12 07:59:16 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesActionsTest-236815586-project-member Apr 12 07:59:16 user devstack@n-api.service[72695]: method: > Apr 12 07:59:16 user devstack@n-api.service[72695]: exception: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. Apr 12 07:59:16 user devstack@n-api.service[72695]: action_args: {'id': 'b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd'} Apr 12 07:59:16 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. Apr 12 07:59:16 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 07:59:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] Returning 404 to user: Instance b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:59:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1441340f-2694-440e-bcd3-98059549e4be tempest-VolumesActionsTest-236815586 tempest-VolumesActionsTest-236815586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd" status: 404 len: 111 microversion: 2.1 time: 0.272044 Apr 12 07:59:16 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 280/838] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:59:16 2023] GET /compute/v2.1/servers/b33c3fb8-3c4b-4310-8d6e-03b615a5cfdd => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f123ec21-5b56-4138-96e6-41004d549fb8 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action" status: 204 len: 0 microversion: 2.1 time: 0.071319 Apr 12 07:59:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 280/839] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 07:59:22 2023] POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=12 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:22 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:59:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d5bbb989-6ce0-43a3-8ca4-82b22e1f0c33 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1553 microversion: 2.1 time: 0.228970 Apr 12 07:59:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 280/840] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:59:22 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:59:58 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:58 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0efcc680-7e8b-4678-806f-2fdc6e32cbf0 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.341190 Apr 12 07:59:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 281/841] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 07:59:58 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments => generated 25 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:59:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HTTP exception thrown: Instance bc267429-544b-4145-b4d9-8c2947c8c104 is not attached to volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Request method failure captured: Apr 12 07:59:59 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments/3a3299e9-bd95-4ab4-9424-716b655b0b2f HTTP/1.1 Apr 12 07:59:59 user devstack@n-api.service[72696]: Accept: application/json Apr 12 07:59:59 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 07:59:59 user devstack@n-api.service[72696]: Connection: close Apr 12 07:59:59 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 07:59:59 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 07:59:59 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 07:59:59 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 07:59:59 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmJ5ao-WRAXy0VExSi6xSlZHm91MPS2bCNobtXwmgm4g181xmsxShJlDalRCOhg2SJ_9LMiZjZnmPry69nkeoO8UkUIHPM-QZ_qv4MbTv_Mt7lPD_zuFnA6JJZ31hkRn5GoigmJejJiilWYgQyqtHJo1Dgu8o_leo4mPAG-QGwPmQOQ Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Project-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Tenant: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Tenant-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-User: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:59:59 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 07:59:59 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 07:59:59 user devstack@n-api.service[72696]: X-User-Id: 630f8381d3534fd3a1978fc0a931e8c0 Apr 12 07:59:59 user devstack@n-api.service[72696]: X-User-Name: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 07:59:59 user devstack@n-api.service[72696]: method: > Apr 12 07:59:59 user devstack@n-api.service[72696]: exception: Instance bc267429-544b-4145-b4d9-8c2947c8c104 is not attached to volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f Apr 12 07:59:59 user devstack@n-api.service[72696]: action_args: {'server_id': 'bc267429-544b-4145-b4d9-8c2947c8c104', 'id': '3a3299e9-bd95-4ab4-9424-716b655b0b2f'} Apr 12 07:59:59 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3a3299e9-bd95-4ab4-9424-716b655b0b2f. Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc267429-544b-4145-b4d9-8c2947c8c104 is not attached to volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc267429-544b-4145-b4d9-8c2947c8c104 is not attached to volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f Apr 12 07:59:59 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 07:59:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Returning 404 to user: Instance bc267429-544b-4145-b4d9-8c2947c8c104 is not attached to volume 3a3299e9-bd95-4ab4-9424-716b655b0b2f {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:59:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-51fe7390-4582-4c6e-bfce-adf9610f7a6f tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments/3a3299e9-bd95-4ab4-9424-716b655b0b2f" status: 404 len: 154 microversion: 2.1 time: 0.296630 Apr 12 07:59:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 281/842] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 07:59:59 2023] DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104/os-volume_attachments/3a3299e9-bd95-4ab4-9424-716b655b0b2f => generated 154 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=10 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:01 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:00:01 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d4bd9e46-3406-4513-be83-424cadd0a0cb tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 204 len: 0 microversion: 2.1 time: 0.114018 Apr 12 08:00:01 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 281/843] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:00:01 2023] DELETE /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:01 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630f8381d3534fd3a1978fc0a931e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f4f7b1930e48cb82f5f6010872e221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:00:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b82ed993-6adc-439e-a3e3-434c4ef974aa tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 200 len: 1541 microversion: 2.1 time: 0.175755 Apr 12 08:00:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 282/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:00:01 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-unplugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] Creating event network-vif-unplugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 08:00:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-515e3872-eb2d-4d39-adf9-6d916205f1aa req-33c8d20b-e431-4bd3-ba66-d6978c1d9d70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034209 Apr 12 08:00:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 282/845] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}, {"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}, {"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-plugged", "status": "completed", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}, {"server_uuid": "bc267429-544b-4145-b4d9-8c2947c8c104", "name": "network-vif-deleted", "tag": "277f41f9-00ba-4f58-9186-da42879de40e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 08:00:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 08:00:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Creating event network-vif-plugged:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 08:00:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] Creating event network-vif-deleted:277f41f9-00ba-4f58-9186-da42879de40e for instance bc267429-544b-4145-b4d9-8c2947c8c104 on user Apr 12 08:00:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-8a74b637-095f-45ee-a92f-ed3e93e5e3cb req-7633f551-f63e-4f7e-b536-7758310a848c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031173 Apr 12 08:00:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 282/846] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=12 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "a2a9667b-9b94-4320-9af3-051b6e3a034d"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:12 user devstack@n-api.service[72696]: DEBUG nova.objects.instance [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lazy-loading 'flavor' on Instance uuid 097391de-d8e8-4023-b839-a306aedfb0b2 {{(pid=72696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:00:12 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:00:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0009cb06-b94f-495a-bfba-da97edf4d06e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1545 microversion: 2.1 time: 0.207936 Apr 12 08:00:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 283/847] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:00:12 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-da144734-3bfa-4334-af44-631f68d146ba tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2/action" status: 200 len: 29 microversion: 2.87 time: 0.368545 Apr 12 08:00:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 283/848] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:00:12 2023] POST /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2/action => generated 29 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:00:13 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:00:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-91ccf8ec-13ac-4e28-baf8-d607bbeb2dd1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1774 microversion: 2.87 time: 0.345725 Apr 12 08:00:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 283/849] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:00:13 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1774 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:00:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] Creating event network-vif-unplugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:00:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-94439dc3-2d9b-4463-9f47-ec3744a2aa27 req-dc5f0a8b-7a65-4dc7-a8c5-afd8fa270326 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034109 Apr 12 08:00:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 284/850] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:00:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-74a9f4b4-d646-4dcb-900b-01d4679f18ac req-47e2e208-8bda-4752-bf5b-a0c443269eb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039895 Apr 12 08:00:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 284/851] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:00:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-0657a254-63eb-4ac0-a223-ea8a28686b7c req-b0e7c43e-3cd2-437d-8521-9de0815e573f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040568 Apr 12 08:00:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 284/852] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:20 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:00:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:20 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:00:20 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fcbeb1d1-ed11-4662-953b-dbc709de2154 req-1f613c7f-e036-483a-9f3b-9adbe0bef68c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029392 Apr 12 08:00:20 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 285/853] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:00:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] [instance: bc267429-544b-4145-b4d9-8c2947c8c104] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:00:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] HTTP exception thrown: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Request method failure captured: Apr 12 08:00:51 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 HTTP/1.1 Apr 12 08:00:51 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:00:51 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:00:51 user devstack@n-api.service[72696]: Connection: close Apr 12 08:00:51 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:00:51 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:00:51 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:00:51 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:00:51 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmJ5ao-WRAXy0VExSi6xSlZHm91MPS2bCNobtXwmgm4g181xmsxShJlDalRCOhg2SJ_9LMiZjZnmPry69nkeoO8UkUIHPM-QZ_qv4MbTv_Mt7lPD_zuFnA6JJZ31hkRn5GoigmJejJiilWYgQyqtHJo1Dgu8o_leo4mPAG-QGwPmQOQ Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Project-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27f4f7b1930e48cb82f5f6010872e221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Tenant: tempest-TestMinimumBasicScenario-1759703879 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Tenant-Id: 27f4f7b1930e48cb82f5f6010872e221 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1759703879 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-User: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 08:00:51 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:00:51 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:00:51 user devstack@n-api.service[72696]: X-User-Id: 630f8381d3534fd3a1978fc0a931e8c0 Apr 12 08:00:51 user devstack@n-api.service[72696]: X-User-Name: tempest-TestMinimumBasicScenario-1759703879-project-member Apr 12 08:00:51 user devstack@n-api.service[72696]: method: > Apr 12 08:00:51 user devstack@n-api.service[72696]: exception: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. Apr 12 08:00:51 user devstack@n-api.service[72696]: action_args: {'id': 'bc267429-544b-4145-b4d9-8c2947c8c104'} Apr 12 08:00:51 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. Apr 12 08:00:51 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:00:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Returning 404 to user: Instance bc267429-544b-4145-b4d9-8c2947c8c104 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:00:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-6b9bc502-d409-4931-acf3-18696dd8f858 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104" status: 404 len: 111 microversion: 2.1 time: 0.036525 Apr 12 08:00:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 285/854] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:00:51 2023] GET /compute/v2.1/servers/bc267429-544b-4145-b4d9-8c2947c8c104 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:00:51 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:51 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:00:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-322e607d-7eec-4d14-ba36-2f4722db97d1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] Calling method '.version_select at 0x7f7bf47c3250>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:00:52 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-322e607d-7eec-4d14-ba36-2f4722db97d1 tempest-TestMinimumBasicScenario-1759703879 tempest-TestMinimumBasicScenario-1759703879-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-623587583" status: 202 len: 0 microversion: 2.1 time: 0.040803 Apr 12 08:00:52 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 285/855] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 12 08:00:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-623587583 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:03 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ea23230c-342a-4c1c-bfe8-04353af99e69 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1754 microversion: 2.87 time: 0.173513 Apr 12 08:01:03 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 286/856] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:01:03 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:01:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b5725746-9085-43d9-9815-d62d5478e7be tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Action: 'create', calling method: .version_select at 0x7f7c052b29e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1002003019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuOD0rpfP4PuUuMOKQ886jPUA8umFYO3482wsn3saWm5WKkTYtyvd+nkSzVXl+KmgM9bHfb/6SatPAH9nmFuVos+mspQRjRxiwLhpZq+bO889TxjK74mrxGmUAeaT1p8Q=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:12 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b5725746-9085-43d9-9815-d62d5478e7be tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting quotas for project 099602ab0d4d4b61ab2482765efc5ae3. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:01:12 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-b5725746-9085-43d9-9815-d62d5478e7be tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting quotas for user e22b66482dae4ed6bfc51cab82b4fd7d and project 099602ab0d4d4b61ab2482765efc5ae3. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:01:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b5725746-9085-43d9-9815-d62d5478e7be tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332098 Apr 12 08:01:12 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 286/857] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:01:12 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:01:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-ba9d1693-6e6b-4456-b435-7bb3e7d141e1 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1545 microversion: 2.1 time: 0.395995 Apr 12 08:01:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 286/858] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:01:12 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1545 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cd709e24-8d6a-4517-8d7b-817656bfc5e6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action" status: 200 len: 28335 microversion: 2.1 time: 0.227476 Apr 12 08:01:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 287/859] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 08:01:13 2023] POST /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4/action => generated 28335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:13 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-055ef29a-b469-4a1d-b537-c49c28acf19d tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 200 len: 1538 microversion: 2.1 time: 0.166635 Apr 12 08:01:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 287/860] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:01:13 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 1538 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:01:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-926015954", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1002003019", "security_groups": [{"name": "tempest-secgroup-smoke-1921573132"}], "networks": [{"uuid": "bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8"}], "block_device_mapping_v2": [{"uuid": "2f2932d3-d52a-469c-aa79-0d22cd0d5e76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:16 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] validate_networks() for [('bdd7d3c1-3f94-4ebd-a9a8-c90b2d9b96d8', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting quotas for project 099602ab0d4d4b61ab2482765efc5ae3. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Getting quotas for user e22b66482dae4ed6bfc51cab82b4fd7d and project 099602ab0d4d4b61ab2482765efc5ae3. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:01:17 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f2932d3-d52a-469c-aa79-0d22cd0d5e76',volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:01:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-569c8a72-b6b3-4295-a50b-261b10ced6ba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.890500 Apr 12 08:01:17 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 287/861] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:01:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:01:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d1bad0bf-ef2e-4868-9ce3-b574ca8c40ca tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:01:17 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d1bad0bf-ef2e-4868-9ce3-b574ca8c40ca tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:01:17 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d1bad0bf-ef2e-4868-9ce3-b574ca8c40ca tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:01:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d1bad0bf-ef2e-4868-9ce3-b574ca8c40ca tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1083 microversion: 2.1 time: 0.066815 Apr 12 08:01:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 288/862] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:01:17 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1083 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:01:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] Creating event network-changed:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:01:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-a1913ce9-d157-43f1-a118-b1880c2dc064 req-dfe23305-0d5f-4595-b9bb-85b9385a747b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095371 Apr 12 08:01:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 288/863] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:01:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:01:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-f9a4546c-f310-4b40-9e1c-ff01d129c2dc req-0ed1d9bd-b830-4189-b5be-99b129cecfed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106527 Apr 12 08:01:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:01:28 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:01:28 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:01:28 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-453793b5-e548-45a8-a097-18cf2d8156e7 req-02d4646a-96c1-489e-93a2-5b19873e5383 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Apr 12 08:01:28 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 289/865] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:01:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-27a24a89-db91-414c-aec6-51a83251f822 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2/action" status: 202 len: 0 microversion: 2.87 time: 0.086228 Apr 12 08:02:03 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 289/866] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:02:03 2023] POST /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=10 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:04 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:04 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:04 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-832bd00d-bcb7-450f-a84a-f2889a9098b6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1762 microversion: 2.87 time: 0.226223 Apr 12 08:02:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 289/867] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:02:03 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1762 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] Creating event network-vif-unplugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:02:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-fbb4c9b5-9422-41d4-a700-f118b524804b req-e277bbdb-cbe4-4209-8284-1bb8db060fc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035199 Apr 12 08:02:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 290/868] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}, {"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:02:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:02:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-8c4bd405-9fb5-4542-aeca-20b68aa02088 req-d904e0f5-9338-4b26-a7e9-3b807e0617b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041810 Apr 12 08:02:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 290/869] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:07 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8225af76-e8cf-40e6-a577-eac55e3ab06f tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1434 microversion: 2.1 time: 0.163611 Apr 12 08:02:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 290/870] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:02:07 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1434 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:02:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:02:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3d6f99f7-558b-468e-aae5-5ab72f0f5a40 req-3988b2c0-baff-43c4-b34b-e274186dc3ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031143 Apr 12 08:02:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 291/871] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:13 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:14 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:02:14 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c0300069-2f90-4e99-9992-96c8939a8edf tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 204 len: 0 microversion: 2.1 time: 0.124681 Apr 12 08:02:14 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 291/872] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:02:13 2023] DELETE /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:14 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-3e2402ff-f10c-456a-a94f-a5b491238140 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 200 len: 1551 microversion: 2.1 time: 0.163983 Apr 12 08:02:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 291/873] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:02:14 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:02:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-unplugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] Creating event network-vif-unplugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 08:02:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-0a3dda11-148c-4585-8c40-0f7992be3b6c req-8be89f0c-cdde-4504-8d9d-69ceca336f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103935 Apr 12 08:02:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 292/874] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-deleted", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] Creating event network-vif-deleted:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 08:02:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-005167bc-f5c1-428f-b913-e01f4c2e55b6 req-2aa60eab-e944-44d8-a9c2-da8bdd1aaf27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Apr 12 08:02:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 292/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2485039-dabb-4fd6-85a3-2053001139e4", "name": "network-vif-plugged", "status": "completed", "tag": "eeac49a6-c1b5-4fcd-9fae-4caa4f651618"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:02:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] Creating event network-vif-plugged:eeac49a6-c1b5-4fcd-9fae-4caa4f651618 for instance a2485039-dabb-4fd6-85a3-2053001139e4 on user Apr 12 08:02:16 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-52e6883e-e619-4f12-8400-a227266a62c5 req-8c29e4bd-1e1a-47c1-aa31-221fa5f61314 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029633 Apr 12 08:02:16 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 292/876] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:54 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:02:54 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b4b135cd-22c1-4cfc-bdea-e26489f9e8c6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1768 microversion: 2.87 time: 0.166376 Apr 12 08:02:54 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 293/877] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:02:54 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1768 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:04 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 HTTP/1.1 Apr 12 08:03:04 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:03:04 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:03:04 user devstack@n-api.service[72696]: Connection: close Apr 12 08:03:04 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:03:04 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:03:04 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:03:04 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:03:04 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72696]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72696]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:04 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72696]: method: > Apr 12 08:03:04 user devstack@n-api.service[72696]: exception: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72696]: action_args: {'id': 'a2485039-dabb-4fd6-85a3-2053001139e4'} Apr 12 08:03:04 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3f5bfbc1-734a-4682-836b-cd9373c5e93f tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 404 len: 111 microversion: 2.1 time: 0.043233 Apr 12 08:03:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 293/878] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:04 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=10 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=20 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:04 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 HTTP/1.1 Apr 12 08:03:04 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:03:04 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:03:04 user devstack@n-api.service[72697]: Connection: close Apr 12 08:03:04 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:03:04 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:03:04 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:03:04 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:03:04 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72697]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72697]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:04 user devstack@n-api.service[72697]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72697]: method: > Apr 12 08:03:04 user devstack@n-api.service[72697]: exception: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72697]: action_args: {'id': 'a2485039-dabb-4fd6-85a3-2053001139e4'} Apr 12 08:03:04 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4d56f6c8-46e5-4952-a102-608758573dc9 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 404 len: 111 microversion: 2.1 time: 0.033972 Apr 12 08:03:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 293/879] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:03:04 2023] DELETE /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: a2485039-dabb-4fd6-85a3-2053001139e4] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:04 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 HTTP/1.1 Apr 12 08:03:04 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:03:04 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:03:04 user devstack@n-api.service[72695]: Connection: close Apr 12 08:03:04 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:03:04 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:03:04 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:03:04 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:03:04 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:04 user devstack@n-api.service[72695]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:03:04 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:03:04 user devstack@n-api.service[72695]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:04 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:04 user devstack@n-api.service[72695]: method: > Apr 12 08:03:04 user devstack@n-api.service[72695]: exception: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72695]: action_args: {'id': 'a2485039-dabb-4fd6-85a3-2053001139e4'} Apr 12 08:03:04 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. Apr 12 08:03:04 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance a2485039-dabb-4fd6-85a3-2053001139e4 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-35d58fe3-8317-4233-ada7-b9f52a38a116 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4" status: 404 len: 111 microversion: 2.1 time: 0.033147 Apr 12 08:03:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 294/880] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:04 2023] GET /compute/v2.1/servers/a2485039-dabb-4fd6-85a3-2053001139e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:03:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4954399e-d7ce-46d9-b42c-19a2debf24c5 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 204 len: 0 microversion: 2.1 time: 0.119703 Apr 12 08:03:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 294/881] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:03:04 2023] DELETE /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b45cf78564f5092726eaeac38675e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0323c8eafc4012883daccef045d4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c315d2a0-fae8-47fc-ad28-a455e51a0061 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 200 len: 1544 microversion: 2.1 time: 0.203945 Apr 12 08:03:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 294/882] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:04 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 1544 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] Creating event network-vif-unplugged:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 08:03:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-8fced229-d25e-4d00-a8cb-d6b9e0f41e09 req-0f9eaeec-3583-4504-be51-007aaa1bec70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034988 Apr 12 08:03:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 295/883] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "name": "network-vif-deleted", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] Creating event network-vif-deleted:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 08:03:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-08cfdc01-e2ca-408f-987f-ebba6e1af8d7 req-197c116f-0a8e-46c7-aeef-b1229d45359e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030534 Apr 12 08:03:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 295/884] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dcaf13a-b6cd-4a95-92ec-febb027915d3", "name": "network-vif-plugged", "status": "completed", "tag": "2bf3e827-1777-48cf-a8fc-0eeff964afe7"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] Creating event network-vif-plugged:2bf3e827-1777-48cf-a8fc-0eeff964afe7 for instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 on user Apr 12 08:03:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-6e4265c3-acac-4e3c-b0bc-fb7dd69753fa req-7b9de10f-ce40-404d-841d-d77fc889df74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031720 Apr 12 08:03:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 295/885] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:08 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-34889fdf-47b5-469b-96d6-c197bbb473bf tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1434 microversion: 2.1 time: 0.142680 Apr 12 08:03:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 296/886] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:08 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1434 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:03:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:09 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] Creating event network-changed:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:03:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-6f0d48c0-9524-4586-9bcb-fdd56a6a8102 req-410ee1f7-a380-40b9-bc52-a15a44942cb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031919 Apr 12 08:03:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 296/887] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:09 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lazy-loading 'flavor' on Instance uuid f3b8aaf8-08b9-43e1-bb54-145e57ba5593 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:03:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-86fdd6a1-1b87-4a59-aa17-772c5e1ef299 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/action" status: 202 len: 0 microversion: 2.1 time: 0.110328 Apr 12 08:03:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 296/888] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 08:03:09 2023] POST /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:10 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-33cfd31e-aae2-4d85-882d-628c18135fa0 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1440 microversion: 2.1 time: 0.171598 Apr 12 08:03:10 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 297/889] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:09 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1440 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:03:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-unplugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}, {"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Creating event network-vif-unplugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:03:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:03:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-cb4508c6-6135-42e1-a56b-f4283947599c req-85d1a8ec-d5c4-4f9d-a57e-4ddd75872a46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032298 Apr 12 08:03:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 297/890] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] Creating event network-changed:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:03:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a04b51c6-7287-4698-9073-fc8ae036ed6a req-88485e2b-6bf4-45eb-a1de-276d9b438401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035084 Apr 12 08:03:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 297/891] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=16 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:03:54 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-7f4fec04-f9f5-4a4e-b2e1-d5cbaae323e5 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 204 len: 0 microversion: 2.87 time: 0.307107 Apr 12 08:03:54 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 298/892] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:03:54 2023] DELETE /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=10 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 4dcaf13a-b6cd-4a95-92ec-febb027915d3] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:54 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 HTTP/1.1 Apr 12 08:03:54 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:03:54 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:03:54 user devstack@n-api.service[72697]: Connection: close Apr 12 08:03:54 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:03:54 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:03:54 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:03:54 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:03:54 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:54 user devstack@n-api.service[72697]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:54 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:03:54 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:03:54 user devstack@n-api.service[72697]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:54 user devstack@n-api.service[72697]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:54 user devstack@n-api.service[72697]: method: > Apr 12 08:03:54 user devstack@n-api.service[72697]: exception: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. Apr 12 08:03:54 user devstack@n-api.service[72697]: action_args: {'id': '4dcaf13a-b6cd-4a95-92ec-febb027915d3'} Apr 12 08:03:54 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. Apr 12 08:03:54 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 4dcaf13a-b6cd-4a95-92ec-febb027915d3 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-be5c8cde-95ad-4036-b272-09ceff8cf47e tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3" status: 404 len: 111 microversion: 2.1 time: 0.048672 Apr 12 08:03:54 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:54 2023] GET /compute/v2.1/servers/4dcaf13a-b6cd-4a95-92ec-febb027915d3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:54 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:03:54 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c536e384-72a5-4210-bfc6-4404087e86cd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 200 len: 1774 microversion: 2.87 time: 0.189593 Apr 12 08:03:54 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 298/894] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:03:54 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 1774 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:03:55 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:55 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] Creating event network-vif-unplugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:03:55 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-4b3b02e0-d74b-4e8b-bdbe-eca2e47f9c11 req-5552f35b-9ae2-499d-b5ac-b68c40ebceed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037826 Apr 12 08:03:55 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 299/895] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:56 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-deleted", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:56 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] Creating event network-vif-deleted:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:03:56 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-150f1995-6f5a-4e24-b15c-cba15936956e req-fb38efc5-ba0d-4acb-8bd8-997fe9be5718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033270 Apr 12 08:03:56 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 299/896] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097391de-d8e8-4023-b839-a306aedfb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "73e030f7-fd13-48ad-9868-9eff44bd7719"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:03:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] Creating event network-vif-plugged:73e030f7-fd13-48ad-9868-9eff44bd7719 for instance 097391de-d8e8-4023-b839-a306aedfb0b2 on user Apr 12 08:03:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-8170047d-8939-4ac3-91a2-2eaef5fc6fc3 req-6ded4416-ad87-4450-ab69-b0331b50c1cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Apr 12 08:03:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 299/897] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:59 user devstack@n-api.service[72695]: request: DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 HTTP/1.1 Apr 12 08:03:59 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:03:59 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:03:59 user devstack@n-api.service[72695]: Connection: close Apr 12 08:03:59 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:03:59 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:03:59 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:03:59 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:03:59 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72695]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:59 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:03:59 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:03:59 user devstack@n-api.service[72695]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:59 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:59 user devstack@n-api.service[72695]: method: > Apr 12 08:03:59 user devstack@n-api.service[72695]: exception: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72695]: action_args: {'id': '3b7424e4-52aa-4330-a748-006240372716'} Apr 12 08:03:59 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-eedaa60c-7953-4bbd-a3ff-033c4b0be1f6 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 404 len: 111 microversion: 2.1 time: 0.031349 Apr 12 08:03:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 300/898] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:03:59 2023] DELETE /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] [instance: 3b7424e4-52aa-4330-a748-006240372716] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:03:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] HTTP exception thrown: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Request method failure captured: Apr 12 08:03:59 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 HTTP/1.1 Apr 12 08:03:59 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:03:59 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:03:59 user devstack@n-api.service[72697]: Connection: close Apr 12 08:03:59 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:03:59 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:03:59 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:03:59 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:03:59 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmAh15YcBTSqdCwZcpSXLRCJZLI005dvL9RexDAVUIqBHkCnppTsvU-gwPWP8jlC3yQEcxro7sKdS73wzQsZgoXJheJUmc_6-Tq-NI2swhWp306guVrbBa_B0pnoLL3oZT5cHtApme2Huj_JDSwUx9_HyU6ie_0N5B4_8GAOntJPX-k Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Project-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Project-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e0323c8eafc4012883daccef045d4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Tenant: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Tenant-Id: 1e0323c8eafc4012883daccef045d4a5 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-ServerActionsTestJSON-836808185 Apr 12 08:03:59 user devstack@n-api.service[72697]: X-User: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:59 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:03:59 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:03:59 user devstack@n-api.service[72697]: X-User-Id: c21b45cf78564f5092726eaeac38675e Apr 12 08:03:59 user devstack@n-api.service[72697]: X-User-Name: tempest-ServerActionsTestJSON-836808185-project-member Apr 12 08:03:59 user devstack@n-api.service[72697]: method: > Apr 12 08:03:59 user devstack@n-api.service[72697]: exception: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72697]: action_args: {'id': '3b7424e4-52aa-4330-a748-006240372716'} Apr 12 08:03:59 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. Apr 12 08:03:59 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:03:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Returning 404 to user: Instance 3b7424e4-52aa-4330-a748-006240372716 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:03:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b6f6ddbc-bee3-4b45-9963-45b90bbc31a4 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716" status: 404 len: 111 microversion: 2.1 time: 0.035516 Apr 12 08:03:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 300/899] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:03:59 2023] GET /compute/v2.1/servers/3b7424e4-52aa-4330-a748-006240372716 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:03:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3d028ea2-80fa-45ff-a88b-84ba59d43786 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] Calling method '.version_select at 0x7f7c056d1630>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:03:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3d028ea2-80fa-45ff-a88b-84ba59d43786 tempest-ServerActionsTestJSON-836808185 tempest-ServerActionsTestJSON-836808185-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562229555" status: 202 len: 0 microversion: 2.1 time: 0.027447 Apr 12 08:03:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 300/900] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 08:03:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562229555 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:00 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:04:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-534b2902-cda8-4c87-8593-569a42265ddc tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1500 microversion: 2.1 time: 0.139057 Apr 12 08:04:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 301/901] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:04:00 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1500 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:04:04 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-89ce568b-035e-48a8-9bdd-6097980f2ef6 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Action: 'create', calling method: .version_select at 0x7f7bf47c1d80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1668616591"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:04 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-89ce568b-035e-48a8-9bdd-6097980f2ef6 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.444929 Apr 12 08:04:04 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 301/902] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 08:04:04 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 447 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 08:04:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-07eb4eb1-5860-47e6-bf50-bfa34c8f93ec tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c051cd240>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-07eb4eb1-5860-47e6-bf50-bfa34c8f93ec tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 200 len: 345 microversion: 2.1 time: 0.049954 Apr 12 08:04:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 301/903] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:04 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-078cedbf-6432-48dd-af17-df4f4e2a69aa tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c05295f30>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-078cedbf-6432-48dd-af17-df4f4e2a69aa tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 200 len: 346 microversion: 2.1 time: 0.053188 Apr 12 08:04:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 302/904] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:05 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b6841283-aee4-4a1c-a591-42b6813f9e92 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Action: 'create', calling method: .version_select at 0x7f7c0520af80>, body: {"snapshot": {"volume_id": "af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-213079749"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b6841283-aee4-4a1c-a591-42b6813f9e92 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.189048 Apr 12 08:04:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 302/905] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 08:04:05 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-cdd7716d-9535-48e9-87f2-e7f62cf41e40 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c0546a440>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:05 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-cdd7716d-9535-48e9-87f2-e7f62cf41e40 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 200 len: 286 microversion: 2.1 time: 0.037576 Apr 12 08:04:05 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 302/906] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:05 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:05 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c3914e7f-6ccb-4b5a-9f0a-563c04e149c1 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c053e2200>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:05 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c3914e7f-6ccb-4b5a-9f0a-563c04e149c1 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035906 Apr 12 08:04:05 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 303/907] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 08:04:05 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:05 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6fabc77c-5bdc-4457-9a5c-7ed9dcd6d0f1 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7bf47c08b0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:05 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6fabc77c-5bdc-4457-9a5c-7ed9dcd6d0f1 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 200 len: 286 microversion: 2.1 time: 0.040177 Apr 12 08:04:05 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 303/908] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:05 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-2b5bed98-2e0c-4543-b8af-6a3c9d96168c tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c053e7ac0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-2b5bed98-2e0c-4543-b8af-6a3c9d96168c tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 200 len: 287 microversion: 2.1 time: 0.035230 Apr 12 08:04:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 303/909] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:06 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-86f3757a-cc40-468d-9e38-74f4d194f27e tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c05fd1f30>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-86f3757a-cc40-468d-9e38-74f4d194f27e tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 202 len: 0 microversion: 2.1 time: 0.067523 Apr 12 08:04:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 304/910] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 08:04:06 2023] DELETE /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:04:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-f3cf9cb8-e8a5-48f2-86e4-804b248148f3 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7bf47c1360>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-f3cf9cb8-e8a5-48f2-86e4-804b248148f3 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 200 len: 286 microversion: 2.1 time: 0.035616 Apr 12 08:04:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 304/911] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:07 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:08 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:08 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-be1a9e1b-5f8f-45d7-baec-8434ec4818ed tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c0541b1c0>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:08 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-be1a9e1b-5f8f-45d7-baec-8434ec4818ed tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 200 len: 286 microversion: 2.1 time: 0.037903 Apr 12 08:04:08 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 304/912] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:08 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6051ba30-2ffb-49bc-9b3d-660da12c1fd5 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c0516ca60>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-6051ba30-2ffb-49bc-9b3d-660da12c1fd5 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] HTTP exception thrown: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. Apr 12 08:04:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6051ba30-2ffb-49bc-9b3d-660da12c1fd5 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Request method failure captured: Apr 12 08:04:09 user devstack@n-api.service[72695]: request: GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 HTTP/1.1 Apr 12 08:04:09 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:04:09 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:04:09 user devstack@n-api.service[72695]: Connection: close Apr 12 08:04:09 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:04:09 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:04:09 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:04:09 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:04:09 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmXzPgZgltbPkcnzDxKeils2fQ8vW9YgEW3yAUQCqOJJ-DfJ7-D0jd-dmMdtQy2n1ZmlXXY6avdukGVqD-QgO4srEeqJtvAoPI7fIAOew4zHKuXARF8T7upxIHcryhP545s5eXPsh_vvFx1pZeij_C-WHeqo37DOg08A4uSzl_qiiQM Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Project-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Tenant-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:09 user devstack@n-api.service[72695]: X-User: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:09 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:04:09 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:04:09 user devstack@n-api.service[72695]: X-User-Id: 53a9d9664f884fe5b51a2a7f591ce0ff Apr 12 08:04:09 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:09 user devstack@n-api.service[72695]: method: Apr 12 08:04:09 user devstack@n-api.service[72695]: exception: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. Apr 12 08:04:09 user devstack@n-api.service[72695]: action_args: {'id': 'd88f5642-2f3d-41c5-96ef-5339032b1753'} Apr 12 08:04:09 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. (HTTP 404) (Request-ID: req-9a4c3724-8585-4c01-9cf7-36debcc6d253) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. Apr 12 08:04:09 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6051ba30-2ffb-49bc-9b3d-660da12c1fd5 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Returning 404 to user: Snapshot d88f5642-2f3d-41c5-96ef-5339032b1753 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:04:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6051ba30-2ffb-49bc-9b3d-660da12c1fd5 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753" status: 404 len: 111 microversion: 2.1 time: 0.034218 Apr 12 08:04:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 305/913] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 08:04:09 2023] GET /compute/v2.1/os-snapshots/d88f5642-2f3d-41c5-96ef-5339032b1753 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:04:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-c44a0ef8-1f03-4fad-b502-2c67f0c46a3a tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7bf47c23b0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-c44a0ef8-1f03-4fad-b502-2c67f0c46a3a tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 202 len: 0 microversion: 2.1 time: 0.101261 Apr 12 08:04:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 305/914] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:04:09 2023] DELETE /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:04:09 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7e909ebb-fb4e-45d3-bb02-969d328e4d14 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c05060d30>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:09 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7e909ebb-fb4e-45d3-bb02-969d328e4d14 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 200 len: 345 microversion: 2.1 time: 0.051573 Apr 12 08:04:09 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 305/915] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:09 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:10 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:10 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:10 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-ffa377db-28c3-433b-9fc8-85a56543da5d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c0516d900>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-ffa377db-28c3-433b-9fc8-85a56543da5d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 200 len: 345 microversion: 2.1 time: 0.062929 Apr 12 08:04:10 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 306/916] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:10 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a40da694-0ca9-429e-8059-df1ceb9f001d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c052849d0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-a40da694-0ca9-429e-8059-df1ceb9f001d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] HTTP exception thrown: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a40da694-0ca9-429e-8059-df1ceb9f001d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Request method failure captured: Apr 12 08:04:11 user devstack@n-api.service[72697]: request: GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac HTTP/1.1 Apr 12 08:04:11 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:04:11 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:04:11 user devstack@n-api.service[72697]: Connection: close Apr 12 08:04:11 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:04:11 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:04:11 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:04:11 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:04:11 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmXzPgZgltbPkcnzDxKeils2fQ8vW9YgEW3yAUQCqOJJ-DfJ7-D0jd-dmMdtQy2n1ZmlXXY6avdukGVqD-QgO4srEeqJtvAoPI7fIAOew4zHKuXARF8T7upxIHcryhP545s5eXPsh_vvFx1pZeij_C-WHeqo37DOg08A4uSzl_qiiQM Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Project-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Tenant-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72697]: X-User: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72697]: X-User-Id: 53a9d9664f884fe5b51a2a7f591ce0ff Apr 12 08:04:11 user devstack@n-api.service[72697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72697]: method: Apr 12 08:04:11 user devstack@n-api.service[72697]: exception: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72697]: action_args: {'id': 'af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac'} Apr 12 08:04:11 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. (HTTP 404) (Request-ID: req-8bd3aca7-a1b3-4ac0-b47e-c8e458e41b3b) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a40da694-0ca9-429e-8059-df1ceb9f001d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Returning 404 to user: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:04:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a40da694-0ca9-429e-8059-df1ceb9f001d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 404 len: 109 microversion: 2.1 time: 0.052246 Apr 12 08:04:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 306/917] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:11 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:04:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7bed3c8a-9c0f-421f-a574-a29449deda52 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c056d3f40>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-7bed3c8a-9c0f-421f-a574-a29449deda52 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] HTTP exception thrown: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7bed3c8a-9c0f-421f-a574-a29449deda52 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Request method failure captured: Apr 12 08:04:11 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac HTTP/1.1 Apr 12 08:04:11 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:04:11 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:04:11 user devstack@n-api.service[72696]: Connection: close Apr 12 08:04:11 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:04:11 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:04:11 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:04:11 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:04:11 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmXzPgZgltbPkcnzDxKeils2fQ8vW9YgEW3yAUQCqOJJ-DfJ7-D0jd-dmMdtQy2n1ZmlXXY6avdukGVqD-QgO4srEeqJtvAoPI7fIAOew4zHKuXARF8T7upxIHcryhP545s5eXPsh_vvFx1pZeij_C-WHeqo37DOg08A4uSzl_qiiQM Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Project-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Tenant-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72696]: X-User: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72696]: X-User-Id: 53a9d9664f884fe5b51a2a7f591ce0ff Apr 12 08:04:11 user devstack@n-api.service[72696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72696]: method: Apr 12 08:04:11 user devstack@n-api.service[72696]: exception: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72696]: action_args: {'id': 'af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac'} Apr 12 08:04:11 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. (HTTP 404) (Request-ID: req-9783d0a4-6b93-484a-9b67-44760f02f112) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7bed3c8a-9c0f-421f-a574-a29449deda52 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Returning 404 to user: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:04:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7bed3c8a-9c0f-421f-a574-a29449deda52 tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 404 len: 109 microversion: 2.1 time: 0.043119 Apr 12 08:04:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 306/918] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:04:11 2023] DELETE /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:04:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d6ded72b-e20e-4091-8738-609c20bb571d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Calling method '.version_select at 0x7f7c0516d990>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-d6ded72b-e20e-4091-8738-609c20bb571d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] HTTP exception thrown: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d6ded72b-e20e-4091-8738-609c20bb571d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Request method failure captured: Apr 12 08:04:11 user devstack@n-api.service[72695]: request: GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac HTTP/1.1 Apr 12 08:04:11 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:04:11 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:04:11 user devstack@n-api.service[72695]: Connection: close Apr 12 08:04:11 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:04:11 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:04:11 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:04:11 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:04:11 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmXzPgZgltbPkcnzDxKeils2fQ8vW9YgEW3yAUQCqOJJ-DfJ7-D0jd-dmMdtQy2n1ZmlXXY6avdukGVqD-QgO4srEeqJtvAoPI7fIAOew4zHKuXARF8T7upxIHcryhP545s5eXPsh_vvFx1pZeij_C-WHeqo37DOg08A4uSzl_qiiQM Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Project-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d75ab51aa21418d8416e96da024cc44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Tenant-Id: 2d75ab51aa21418d8416e96da024cc44 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1993319932 Apr 12 08:04:11 user devstack@n-api.service[72695]: X-User: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:04:11 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:04:11 user devstack@n-api.service[72695]: X-User-Id: 53a9d9664f884fe5b51a2a7f591ce0ff Apr 12 08:04:11 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1993319932-project-member Apr 12 08:04:11 user devstack@n-api.service[72695]: method: Apr 12 08:04:11 user devstack@n-api.service[72695]: exception: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72695]: action_args: {'id': 'af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac'} Apr 12 08:04:11 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. (HTTP 404) (Request-ID: req-0ee50573-5359-4caf-b165-a5f14b117d3e) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. Apr 12 08:04:11 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d6ded72b-e20e-4091-8738-609c20bb571d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] Returning 404 to user: Volume af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:04:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d6ded72b-e20e-4091-8738-609c20bb571d tempest-VolumesSnapshotsTestJSON-1993319932 tempest-VolumesSnapshotsTestJSON-1993319932-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac" status: 404 len: 109 microversion: 2.1 time: 0.087708 Apr 12 08:04:11 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 307/919] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:04:11 2023] GET /compute/v2.1/os-volumes/af7cedbb-b54e-4d2a-9fb1-0c5f36b4d9ac => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1556449323", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "networks": [{"uuid": "344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] validate_networks() for [('344d69a6-0086-40a8-ac8e-f3a3a9dcfd1f', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Getting quotas for project 1c02b1f26d0c4f03bde41b79557371a1. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Getting quotas for user 118e1780ab5f4949b02fc04fe3530036 and project 1c02b1f26d0c4f03bde41b79557371a1. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:04:16 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:04:17 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-24ce7230-885a-47e7-ab47-b697568685ed tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.646687 Apr 12 08:04:17 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 307/920] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:04:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:04:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-42f9128e-c3e0-4024-9175-7c5e190facda tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-42f9128e-c3e0-4024-9175-7c5e190facda tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:04:17 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-42f9128e-c3e0-4024-9175-7c5e190facda tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118e1780ab5f4949b02fc04fe3530036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c02b1f26d0c4f03bde41b79557371a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:04:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-42f9128e-c3e0-4024-9175-7c5e190facda tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1" status: 200 len: 1208 microversion: 2.1 time: 0.071127 Apr 12 08:04:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 307/921] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:04:17 2023] GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => generated 1208 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:04:19 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:19 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] Creating event network-changed:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:04:19 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-8bd923a9-c308-4ba1-a4c0-411733625321 req-8b3bd041-2f0d-4c21-b9c2-1a2ad6abf231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074061 Apr 12 08:04:19 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 308/922] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "name": "network-vif-plugged", "status": "completed", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:21 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] Creating event network-vif-plugged:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:04:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-0d5940e7-99ed-4260-9a72-990e88d7b6ea req-dc98a334-ee6a-464b-8713-5b17655a71cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034838 Apr 12 08:04:21 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 308/923] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:23 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "name": "network-vif-plugged", "status": "completed", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:23 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] Creating event network-vif-plugged:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:04:23 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-af02fdfe-312e-479f-ab91-0b22ce00b232 req-49a00c94-18a8-4def-801c-a79652b7e06f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028843 Apr 12 08:04:23 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 308/924] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 097391de-d8e8-4023-b839-a306aedfb0b2] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:44 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HTTP exception thrown: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Request method failure captured: Apr 12 08:04:45 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 HTTP/1.1 Apr 12 08:04:45 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:04:45 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:04:45 user devstack@n-api.service[72695]: Connection: close Apr 12 08:04:45 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:04:45 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:04:45 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:04:45 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:04:45 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmHq8lFVXNyBXcW2nESOD9EupOhETLWAqSks4bMIUphm_dzQ_RlFjXzc7dkbqhWK8Pk6lgCszeDm_oQIUkkb7T5BWcIYI-pvc4o4WEar8Jl9hsiYI36bA3JK69S0siuWEb7HK56uUxfTgOGYYlehrdM3K72L1rFIp2cj5PERrY7qM7Y Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Project-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Tenant-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:04:45 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:04:45 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:04:45 user devstack@n-api.service[72695]: X-User-Id: 2c01e1260cfa45f6b9d225592867f240 Apr 12 08:04:45 user devstack@n-api.service[72695]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:04:45 user devstack@n-api.service[72695]: method: > Apr 12 08:04:45 user devstack@n-api.service[72695]: exception: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. Apr 12 08:04:45 user devstack@n-api.service[72695]: action_args: {'id': '097391de-d8e8-4023-b839-a306aedfb0b2'} Apr 12 08:04:45 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. Apr 12 08:04:45 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Returning 404 to user: Instance 097391de-d8e8-4023-b839-a306aedfb0b2 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:04:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-39d91ccf-ad8f-4762-87d9-20cc12d364ab tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2" status: 404 len: 111 microversion: 2.87 time: 0.044749 Apr 12 08:04:45 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 309/925] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:04:44 2023] GET /compute/v2.1/servers/097391de-d8e8-4023-b839-a306aedfb0b2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:04:45 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-54904117-159b-46cb-ac15-90026540c8ae tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 204 len: 0 microversion: 2.87 time: 0.135887 Apr 12 08:04:45 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 309/926] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:04:45 2023] DELETE /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:04:45 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:04:45 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-32155fec-3af9-4836-a0a0-11f8b7e2c747 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 200 len: 1696 microversion: 2.87 time: 0.245945 Apr 12 08:04:45 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 309/927] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:04:45 2023] GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "name": "network-vif-unplugged", "status": "completed", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] Creating event network-vif-unplugged:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 08:04:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-81183e4a-e9e4-455b-92b8-a7f24b313295 req-cbe5fc04-8a44-419c-ab7a-d1809c1adb0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036068 Apr 12 08:04:45 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 310/928] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:04:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:04:47 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "name": "network-vif-plugged", "status": "completed", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}, {"server_uuid": "c2da4832-f77d-4e42-85f0-8e370c69f7b8", "name": "network-vif-deleted", "tag": "1609868b-1b37-4997-81c6-d1390f862b7e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:04:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:04:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:04:47 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:04:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Creating event network-vif-plugged:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 08:04:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] Creating event network-vif-deleted:1609868b-1b37-4997-81c6-d1390f862b7e for instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 on user Apr 12 08:04:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-57f16fd8-c869-466a-a01c-c7fe0c8d002e req-bb4a3688-984f-4a8c-86a2-ec7fc89c9fcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035805 Apr 12 08:04:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 310/929] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:04:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:00 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72696) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 08:05:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-896bedd1-2726-4dc3-9ae7-7c6be2bfe774 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/action" status: 202 len: 0 microversion: 2.1 time: 0.237588 Apr 12 08:05:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 310/930] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 08:05:00 2023] POST /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:00 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0e7f032b-9d93-493d-93a3-9e2fad88eece tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1508 microversion: 2.1 time: 0.170100 Apr 12 08:05:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 311/931] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:05:00 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:07 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] Creating event network-changed:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:05:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-89f4e686-65e8-465e-ab2d-697eee86a861 req-198763a2-a686-46d3-a66c-85ada72a65bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044816 Apr 12 08:05:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 311/932] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:07 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118e1780ab5f4949b02fc04fe3530036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c02b1f26d0c4f03bde41b79557371a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ed67826a-edda-4ecc-9b74-2646a072779f tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1" status: 200 len: 1485 microversion: 2.1 time: 0.356209 Apr 12 08:05:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 311/933] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:05:07 2023] GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => generated 1485 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:05:10 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:10 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:10 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:05:10 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-7bdc1f21-e7aa-4cb6-8e68-aaa323b90a6e req-9ab916f7-4cce-4459-b703-cf17373ab8d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035003 Apr 12 08:05:10 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 312/934] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:05:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a3f1fc6a-a12e-470c-af15-c2bb3b562702 req-ee6b159f-a3f8-4240-b4cb-13915bacc4f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037060 Apr 12 08:05:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 312/935] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: c2da4832-f77d-4e42-85f0-8e370c69f7b8] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HTTP exception thrown: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Request method failure captured: Apr 12 08:05:35 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 HTTP/1.1 Apr 12 08:05:35 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:05:35 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:05:35 user devstack@n-api.service[72696]: Connection: close Apr 12 08:05:35 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:05:35 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:05:35 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:05:35 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:05:35 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmHq8lFVXNyBXcW2nESOD9EupOhETLWAqSks4bMIUphm_dzQ_RlFjXzc7dkbqhWK8Pk6lgCszeDm_oQIUkkb7T5BWcIYI-pvc4o4WEar8Jl9hsiYI36bA3JK69S0siuWEb7HK56uUxfTgOGYYlehrdM3K72L1rFIp2cj5PERrY7qM7Y Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Project-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Tenant-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:05:35 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:05:35 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:05:35 user devstack@n-api.service[72696]: X-User-Id: 2c01e1260cfa45f6b9d225592867f240 Apr 12 08:05:35 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:05:35 user devstack@n-api.service[72696]: method: > Apr 12 08:05:35 user devstack@n-api.service[72696]: exception: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. Apr 12 08:05:35 user devstack@n-api.service[72696]: action_args: {'id': 'c2da4832-f77d-4e42-85f0-8e370c69f7b8'} Apr 12 08:05:35 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. Apr 12 08:05:35 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:05:35 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Returning 404 to user: Instance c2da4832-f77d-4e42-85f0-8e370c69f7b8 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:05:35 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7b6f2cdb-b484-482a-ab30-386e00bff9f1 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8" status: 404 len: 111 microversion: 2.87 time: 0.038809 Apr 12 08:05:35 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 312/936] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:05:35 2023] GET /compute/v2.1/servers/c2da4832-f77d-4e42-85f0-8e370c69f7b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:05:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-eda8aa10-d210-4406-a254-ce9ae0b379dd tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 204 len: 0 microversion: 2.87 time: 0.123980 Apr 12 08:05:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 313/937] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:05:35 2023] DELETE /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:36 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:36 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:36 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:36 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1f9f3d1e-01d1-489b-9412-1dcab67f8adf tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 200 len: 1774 microversion: 2.87 time: 0.241549 Apr 12 08:05:36 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 313/938] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:05:35 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 1774 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:05:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-unplugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] Creating event network-vif-unplugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 08:05:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f91d4463-00e5-40c2-951d-bc83e71dd401 req-7726d92e-8c2d-4132-a7bd-e14ad58d5e3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035684 Apr 12 08:05:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 313/939] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-deleted", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] Creating event network-vif-deleted:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 08:05:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-6839fb44-d2dd-4efb-b298-36a551c60e34 req-765a94e4-9bf1-4080-bf1f-074bdebfa256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035150 Apr 12 08:05:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 314/940] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 08:05:38 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f136818-14e2-4d2e-81db-cb32a3ecd497", "name": "network-vif-plugged", "status": "completed", "tag": "8eee7860-e187-49d6-8595-784114b9fb4f"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:05:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] Creating event network-vif-plugged:8eee7860-e187-49d6-8595-784114b9fb4f for instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 on user Apr 12 08:05:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-4d1c3e4c-0c84-456b-a902-584f8f504fc2 req-f55d2109-2960-4334-a04c-26379ff50b9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 Apr 12 08:05:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 314/941] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:05:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:05:51 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:05:51 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8e828c68-b1ce-4b70-935a-5b66e585d978 tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1553 microversion: 2.1 time: 0.164277 Apr 12 08:05:51 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 314/942] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:05:50 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:06:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9b67823d-59cf-4623-a257-ea50e6d73051 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1" status: 204 len: 0 microversion: 2.1 time: 0.129816 Apr 12 08:06:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 315/943] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:06:12 2023] DELETE /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:12 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118e1780ab5f4949b02fc04fe3530036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c02b1f26d0c4f03bde41b79557371a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:06:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-b2518d39-7cf9-4ef7-8123-72afb20c0ae0 tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1" status: 200 len: 1491 microversion: 2.1 time: 0.172387 Apr 12 08:06:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 315/944] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:06:12 2023] GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => generated 1491 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] Creating event network-vif-unplugged:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:06:12 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-cf53074c-0841-4f4c-8ed1-aa0093457c08 req-8ce5e74e-b662-4e14-8ec3-d4ecb97155b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034211 Apr 12 08:06:12 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 315/945] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:13 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "name": "network-vif-deleted", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:13 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] Creating event network-vif-deleted:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:06:13 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-c64d74c9-6f54-4829-be56-70c03aca04b2 req-1b156ad8-2f1c-44c4-9a39-9fd6f0fd45e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031765 Apr 12 08:06:13 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 316/946] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:14 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4326088-d99b-4c3d-bfdf-0ef665f14ec1", "name": "network-vif-plugged", "status": "completed", "tag": "1003723d-937c-4399-82af-7ec80698e1c1"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:14 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] Creating event network-vif-plugged:1003723d-937c-4399-82af-7ec80698e1c1 for instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 on user Apr 12 08:06:14 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-386fdacd-3b5c-443e-999f-71ca9fdd4d99 req-df37596c-67fc-4ba1-989d-08ebd22ab4d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Apr 12 08:06:14 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 316/947] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 4f136818-14e2-4d2e-81db-cb32a3ecd497] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HTTP exception thrown: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Request method failure captured: Apr 12 08:06:26 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 HTTP/1.1 Apr 12 08:06:26 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:06:26 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:06:26 user devstack@n-api.service[72696]: Connection: close Apr 12 08:06:26 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:06:26 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:06:26 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:06:26 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:06:26 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmHq8lFVXNyBXcW2nESOD9EupOhETLWAqSks4bMIUphm_dzQ_RlFjXzc7dkbqhWK8Pk6lgCszeDm_oQIUkkb7T5BWcIYI-pvc4o4WEar8Jl9hsiYI36bA3JK69S0siuWEb7HK56uUxfTgOGYYlehrdM3K72L1rFIp2cj5PERrY7qM7Y Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Project-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Tenant-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:06:26 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:06:26 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:06:26 user devstack@n-api.service[72696]: X-User-Id: 2c01e1260cfa45f6b9d225592867f240 Apr 12 08:06:26 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:06:26 user devstack@n-api.service[72696]: method: > Apr 12 08:06:26 user devstack@n-api.service[72696]: exception: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. Apr 12 08:06:26 user devstack@n-api.service[72696]: action_args: {'id': '4f136818-14e2-4d2e-81db-cb32a3ecd497'} Apr 12 08:06:26 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. Apr 12 08:06:26 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Returning 404 to user: Instance 4f136818-14e2-4d2e-81db-cb32a3ecd497 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:06:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-41b05a5c-ac32-4fb4-946c-05a49c70225d tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497" status: 404 len: 111 microversion: 2.87 time: 0.040484 Apr 12 08:06:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 316/948] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:06:26 2023] GET /compute/v2.1/servers/4f136818-14e2-4d2e-81db-cb32a3ecd497 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:06:26 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f0f88e0c-c6b1-451c-a5e6-aa5288065003 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 204 len: 0 microversion: 2.87 time: 0.129457 Apr 12 08:06:26 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 317/949] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:06:26 2023] DELETE /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:06:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c01e1260cfa45f6b9d225592867f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db13f97452634fb888d949ed5382b6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:06:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-07a42ed8-87c8-4fdc-b32a-9e4a179dd310 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 200 len: 1697 microversion: 2.87 time: 0.174898 Apr 12 08:06:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 317/950] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:06:26 2023] GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "name": "network-vif-unplugged", "status": "completed", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] Creating event network-vif-unplugged:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 08:06:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c62c8181-386c-4cba-88cd-fda5ea3f2f26 req-06f5ccd1-16b0-4b3a-84e8-8c9e1e0d4546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029505 Apr 12 08:06:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 317/951] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "name": "network-vif-deleted", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] Creating event network-vif-deleted:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 08:06:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-6e701dc3-c63e-4dd3-b2d3-590ee90eff66 req-d0b42a1b-f348-4703-9380-7084c8d33b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145669 Apr 12 08:06:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 318/952] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c911478-0ca8-4d4c-9875-2497b6307a6d", "name": "network-vif-plugged", "status": "completed", "tag": "28f429c2-3e75-45e6-b544-e3dfc70c9a67"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] Creating event network-vif-plugged:28f429c2-3e75-45e6-b544-e3dfc70c9a67 for instance 6c911478-0ca8-4d4c-9875-2497b6307a6d on user Apr 12 08:06:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-0efbc10f-07f5-4bae-a9b9-37858cad557c req-f850f6b6-6d83-4137-a487-99146f2e66b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Apr 12 08:06:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 318/953] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] Creating event network-changed:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:06:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3f16933a-5673-42bf-a3a5-41fe90ebb3a4 req-98a58289-55d2-482b-baec-8144bd57c249 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039876 Apr 12 08:06:51 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Going to try to terminate instance {{(pid=72696) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:06:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 319/954] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:52 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-48cdbbfd-6995-4258-9cd8-d13df994ceff tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 204 len: 0 microversion: 2.1 time: 0.116277 Apr 12 08:06:52 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 318/955] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:06:51 2023] DELETE /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:52 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22b66482dae4ed6bfc51cab82b4fd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099602ab0d4d4b61ab2482765efc5ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:06:52 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-220101ea-3967-45f7-ae51-e60aca123e7c tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 200 len: 1559 microversion: 2.1 time: 0.299830 Apr 12 08:06:52 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 319/956] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:06:52 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 1559 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:06:52 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-unplugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:52 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] Creating event network-vif-unplugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:06:52 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-c4af51ed-6497-484d-a41f-0dea1be7d9d3 req-1fb402e2-a231-4618-ac9a-21f5d7e432ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092640 Apr 12 08:06:52 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 320/957] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:53 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-deleted", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:53 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] Creating event network-vif-deleted:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:06:53 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-25db8e2c-cb39-4a66-97ea-9d836bf02e34 req-93131321-7a49-4a5f-8ede-b3a0db3a0fac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Apr 12 08:06:53 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 319/958] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:06:54 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b8aaf8-08b9-43e1-bb54-145e57ba5593", "name": "network-vif-plugged", "status": "completed", "tag": "358b6856-7e4e-4c61-979a-fffa9cfe27a9"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:06:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:06:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:06:54 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:06:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] Creating event network-vif-plugged:358b6856-7e4e-4c61-979a-fffa9cfe27a9 for instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 on user Apr 12 08:06:54 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-3dd1c281-7bc3-4cd5-ba4f-215b09088d10 req-272c927f-7add-48ad-b9cb-c3334bb3bae4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030523 Apr 12 08:06:54 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 320/959] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] [instance: f4326088-d99b-4c3d-bfdf-0ef665f14ec1] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] HTTP exception thrown: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Request method failure captured: Apr 12 08:07:02 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 HTTP/1.1 Apr 12 08:07:02 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:07:02 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:07:02 user devstack@n-api.service[72695]: Connection: close Apr 12 08:07:02 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:07:02 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:07:02 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:07:02 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:07:02 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmX-Nwc8YPbm4Nlxoirko9jhZyJwqhOBIWcpPQ01gIyTlIQ_JiqQ6q_vh2pKAjI1Df-OmU--EBK3bzBfDY9KImGwX5EK8N7lvRtriBn7p1iV8IwuRIFGtDWBjzrftfuRz-iB1d8KZ54OVBQbaY0FcKHGYSG57elm0mPz-EMOplAlmMo Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Project-Id: 1c02b1f26d0c4f03bde41b79557371a1 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Project-Name: tempest-VolumesActionsTest-1691614225 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c02b1f26d0c4f03bde41b79557371a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c02b1f26d0c4f03bde41b79557371a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c02b1f26d0c4f03bde41b79557371a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Tenant: tempest-VolumesActionsTest-1691614225 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Tenant-Id: 1c02b1f26d0c4f03bde41b79557371a1 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-VolumesActionsTest-1691614225 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-User: tempest-VolumesActionsTest-1691614225-project-member Apr 12 08:07:02 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:07:02 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:07:02 user devstack@n-api.service[72695]: X-User-Id: 118e1780ab5f4949b02fc04fe3530036 Apr 12 08:07:02 user devstack@n-api.service[72695]: X-User-Name: tempest-VolumesActionsTest-1691614225-project-member Apr 12 08:07:02 user devstack@n-api.service[72695]: method: > Apr 12 08:07:02 user devstack@n-api.service[72695]: exception: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. Apr 12 08:07:02 user devstack@n-api.service[72695]: action_args: {'id': 'f4326088-d99b-4c3d-bfdf-0ef665f14ec1'} Apr 12 08:07:02 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. Apr 12 08:07:02 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:07:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] Returning 404 to user: Instance f4326088-d99b-4c3d-bfdf-0ef665f14ec1 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:07:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4c696ee2-6f9b-4441-bced-95f57dfa116a tempest-VolumesActionsTest-1691614225 tempest-VolumesActionsTest-1691614225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1" status: 404 len: 111 microversion: 2.1 time: 0.035332 Apr 12 08:07:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 321/960] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:07:02 2023] GET /compute/v2.1/servers/f4326088-d99b-4c3d-bfdf-0ef665f14ec1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] [instance: 6c911478-0ca8-4d4c-9875-2497b6307a6d] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] HTTP exception thrown: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Request method failure captured: Apr 12 08:07:16 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d HTTP/1.1 Apr 12 08:07:16 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:07:16 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:07:16 user devstack@n-api.service[72696]: Connection: close Apr 12 08:07:16 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:07:16 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:07:16 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:07:16 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:07:16 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmHq8lFVXNyBXcW2nESOD9EupOhETLWAqSks4bMIUphm_dzQ_RlFjXzc7dkbqhWK8Pk6lgCszeDm_oQIUkkb7T5BWcIYI-pvc4o4WEar8Jl9hsiYI36bA3JK69S0siuWEb7HK56uUxfTgOGYYlehrdM3K72L1rFIp2cj5PERrY7qM7Y Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Project-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db13f97452634fb888d949ed5382b6c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Tenant-Id: db13f97452634fb888d949ed5382b6c4 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:07:16 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:07:16 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:07:16 user devstack@n-api.service[72696]: X-User-Id: 2c01e1260cfa45f6b9d225592867f240 Apr 12 08:07:16 user devstack@n-api.service[72696]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member Apr 12 08:07:16 user devstack@n-api.service[72696]: method: > Apr 12 08:07:16 user devstack@n-api.service[72696]: exception: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. Apr 12 08:07:16 user devstack@n-api.service[72696]: action_args: {'id': '6c911478-0ca8-4d4c-9875-2497b6307a6d'} Apr 12 08:07:16 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. Apr 12 08:07:16 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:07:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] Returning 404 to user: Instance 6c911478-0ca8-4d4c-9875-2497b6307a6d could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:07:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-0006f040-49cd-450b-8bb0-63e017b641a6 tempest-ServerBootFromVolumeStableRescueTest-1210893055 tempest-ServerBootFromVolumeStableRescueTest-1210893055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d" status: 404 len: 111 microversion: 2.87 time: 0.039309 Apr 12 08:07:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 320/961] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:07:16 2023] GET /compute/v2.1/servers/6c911478-0ca8-4d4c-9875-2497b6307a6d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:07:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a2b05ae8-43b2-454f-9abc-004478ff064a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: .version_select at 0x7f7c05578f70>, body: {"keypair": {"name": "tempest-keypair-1482956523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGUsZk+0FFRlxN7ot18soKqADFCkS7i/wDGGcWd/SeiRgvm3dHu7GHBm8NFwvIgAzAthDChntTADY+w7rAzzxwPIbXCJPKJLjzBnPTlb5heDyZwU3YMzanBVuqyf5fx2A=="}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:07:28 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-a2b05ae8-43b2-454f-9abc-004478ff064a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:07:28 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-a2b05ae8-43b2-454f-9abc-004478ff064a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for user 705c265380f543848a986352fa2e385c and project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'key_pairs'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:07:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a2b05ae8-43b2-454f-9abc-004478ff064a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.204632 Apr 12 08:07:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 321/962] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 08:07:28 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1715890719", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "008fc615-654d-414f-bc6f-fe11af903e1f"}], "security_groups": [{"name": "tempest-securitygroup--1390123874"}], "key_name": "tempest-keypair-1482956523", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] validate_networks() for [('008fc615-654d-414f-bc6f-fe11af903e1f', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for user 705c265380f543848a986352fa2e385c and project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:07:30 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:07:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d5604274-b151-467b-a581-1c48bca0377e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.787654 Apr 12 08:07:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 322/963] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 08:07:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:07:30 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:07:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4eb2efd4-96a9-42f3-ad7e-a47667cc8d32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1276 microversion: 2.20 time: 0.079001 Apr 12 08:07:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 321/964] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:07:30 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:07:33 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:07:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:33 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] Creating event network-changed:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:07:33 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-b1e04107-b70e-4e37-bdc2-0376264c5d7e req-b4e61fa3-fce4-4ef8-8280-4433242185f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073634 Apr 12 08:07:33 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 322/965] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:07:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:07:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:07:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-910415df-4a1a-4f14-be1e-dcb14d7f1c1d req-9c3e4edf-b687-46e7-840e-96b4e584b8c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100007 Apr 12 08:07:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 323/966] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 08:07:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:07:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:07:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-135c41f4-02a8-4607-a6c4-922b3820ff4a req-14cab875-dd9b-4ca3-9026-5be6d4232df4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033053 Apr 12 08:07:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 322/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] [instance: f3b8aaf8-08b9-43e1-bb54-145e57ba5593] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:07:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] HTTP exception thrown: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Request method failure captured: Apr 12 08:07:42 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 HTTP/1.1 Apr 12 08:07:42 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:07:42 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:07:42 user devstack@n-api.service[72697]: Connection: close Apr 12 08:07:42 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:07:42 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:07:42 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:07:42 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:07:42 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmVBeX0Y9_Xv4H8U3uUGFXfFqUzAeWPQuuliY_e6uWlV6fYa7DM2zgg6FnTk8jdNvMbMOrzKaIXXdyuL4l_mfYhuk_kRPwTjECQiJlPGZzeInVmUMy-w6vXE-jE5TOVRXlmYG4O2pre7hZjCHy7J-CrCcAi6uS_9DkCgVsjvODTxt7I Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Project-Id: 099602ab0d4d4b61ab2482765efc5ae3 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Project-Name: tempest-TestShelveInstance-86825625 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/099602ab0d4d4b61ab2482765efc5ae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/099602ab0d4d4b61ab2482765efc5ae3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/099602ab0d4d4b61ab2482765efc5ae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Tenant: tempest-TestShelveInstance-86825625 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Tenant-Id: 099602ab0d4d4b61ab2482765efc5ae3 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-TestShelveInstance-86825625 Apr 12 08:07:42 user devstack@n-api.service[72697]: X-User: tempest-TestShelveInstance-86825625-project-member Apr 12 08:07:42 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:07:42 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:07:42 user devstack@n-api.service[72697]: X-User-Id: e22b66482dae4ed6bfc51cab82b4fd7d Apr 12 08:07:42 user devstack@n-api.service[72697]: X-User-Name: tempest-TestShelveInstance-86825625-project-member Apr 12 08:07:42 user devstack@n-api.service[72697]: method: > Apr 12 08:07:42 user devstack@n-api.service[72697]: exception: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. Apr 12 08:07:42 user devstack@n-api.service[72697]: action_args: {'id': 'f3b8aaf8-08b9-43e1-bb54-145e57ba5593'} Apr 12 08:07:42 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. Apr 12 08:07:42 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:07:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Returning 404 to user: Instance f3b8aaf8-08b9-43e1-bb54-145e57ba5593 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:07:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-bb9ca9f0-b5d8-46fb-90d2-749f24a80aba tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593" status: 404 len: 111 microversion: 2.1 time: 0.042902 Apr 12 08:07:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 323/968] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:07:42 2023] GET /compute/v2.1/servers/f3b8aaf8-08b9-43e1-bb54-145e57ba5593 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:07:42 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:42 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:07:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9fbc335f-84d3-4c45-9c5d-d15d57ec169a tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] Calling method '.version_select at 0x7f7c04f83b50>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:07:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9fbc335f-84d3-4c45-9c5d-d15d57ec169a tempest-TestShelveInstance-86825625 tempest-TestShelveInstance-86825625-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1002003019" status: 202 len: 0 microversion: 2.1 time: 0.041122 Apr 12 08:07:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 324/969] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 08:07:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1002003019 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-595be35f-f8cb-447a-b0f2-b9034bc9ec50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'create', calling method: .version_select at 0x7f7c05060d30>, body: {"keypair": {"name": "tempest-TestStampPattern-598492705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdasC+Q0iBfQAIBj7bjiz3vOtXegvhnEtGjtKru+SGbqR+AguyykUIDVzZ57a6ws1eVKimtdAZWDnLUqSdY3zj2yQDWcUGE9vc0IGm/WOKQn6AfDRBEL8EcldLkTG98Q=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-595be35f-f8cb-447a-b0f2-b9034bc9ec50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:08:04 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-595be35f-f8cb-447a-b0f2-b9034bc9ec50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for user 97536e3b50284fbc81a9188166e90a7a and project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:08:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-595be35f-f8cb-447a-b0f2-b9034bc9ec50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.271910 Apr 12 08:08:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 323/970] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:08:04 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2015532211", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "key_name": "tempest-TestStampPattern-598492705", "security_groups": [{"name": "tempest-secgroup-smoke-194245248"}], "networks": [{"uuid": "04a0ab6e-5794-4409-9c51-d6debd57a18b"}]}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] validate_networks() for [('04a0ab6e-5794-4409-9c51-d6debd57a18b', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:08:07 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for user 97536e3b50284fbc81a9188166e90a7a and project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:08:08 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:08:08 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-19e8337c-6f00-420d-9c51-5a99e42c4132 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.708721 Apr 12 08:08:08 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 324/971] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:08:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:08:08 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:08 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0aef7f7b-2aec-440c-ab65-c39a5bbb362f tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:08:08 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0aef7f7b-2aec-440c-ab65-c39a5bbb362f tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:08:08 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0aef7f7b-2aec-440c-ab65-c39a5bbb362f tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:08:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0aef7f7b-2aec-440c-ab65-c39a5bbb362f tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 200 len: 1236 microversion: 2.1 time: 0.099606 Apr 12 08:08:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 325/972] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:08:08 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:08:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:08:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] Creating event network-changed:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:08:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-a563fde7-b833-46bf-8fce-7774252134d7 req-fbc70880-a876-43c7-833a-0ae112220b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029559 Apr 12 08:08:10 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 324/973] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:08:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:08:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] Creating event network-vif-plugged:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:08:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-207d01af-f3d2-4aa6-8ce1-b0657fd36755 req-a3c44ce4-e169-413f-bdfa-7b07109184a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Apr 12 08:08:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 325/974] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:08:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:08:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] Creating event network-vif-plugged:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:08:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-6ef8c369-5726-4c32-b550-0f53270313aa req-72499955-75b3-4cb8-a925-781e7b74f950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028726 Apr 12 08:08:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 326/975] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:08:21 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:08:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-88e03323-54f8-40ba-9b20-285b9c921a18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1588 microversion: 2.20 time: 0.168426 Apr 12 08:08:21 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 325/976] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:08:20 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1588 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:08:58 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:08:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-fa2e8ba4-601c-4a7f-897e-65a14203bf44 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 200 len: 1538 microversion: 2.1 time: 0.155813 Apr 12 08:08:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 326/977] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:08:58 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 1538 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:21 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:21 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b7d977af-fb60-4f56-b24d-53200ed33c26 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.108332 Apr 12 08:09:21 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 327/978] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 08:09:21 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] Creating event network-changed:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:09:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-9af502fc-71b3-4e8f-a7a6-bf57df6cbd55 req-d1f0d89f-18d6-40c3-a661-d5c8eb140e6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037794 Apr 12 08:09:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 326/979] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2af0b25a-d6c8-4dc1-939a-5d7a91cea226 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/ips" status: 200 len: 110 microversion: 2.20 time: 0.040976 Apr 12 08:09:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 327/980] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 08:09:22 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:23 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'flavor' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:09:24 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-15d069e6-7146-4662-9e17-737e1ad93a91 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/action" status: 202 len: 0 microversion: 2.20 time: 1.036984 Apr 12 08:09:24 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 328/981] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:09:23 2023] POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:24 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:09:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:09:25 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:09:25 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7c1b5620-39eb-4815-acfd-574726067c5f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1713 microversion: 2.20 time: 0.222273 Apr 12 08:09:25 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 327/982] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:09:24 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1713 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:09:25 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:09:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:25 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:25 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] Creating event network-vif-unplugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:09:25 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-7a81a798-19bf-4138-a829-6b04093323ef req-b7572f22-f795-41dd-ba54-918d8b80472d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034490 Apr 12 08:09:25 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 328/983] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:09:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:09:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:09:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-ce5d3c9c-b7d9-4649-bfa4-48d4fcd22387 req-5e349dc8-06c5-4578-a0f1-3677536c3e33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030886 Apr 12 08:09:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 329/984] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:09:29 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:09:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] Creating event network-changed:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:09:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-9c12dc9f-d725-4730-8bc3-b426c41200c5 req-e59ffbe9-adff-4a5f-a422-c12d9d5d7859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037097 Apr 12 08:09:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 328/985] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:09:58 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:09:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8949ba76-7bd3-48c0-9433-5066177fdd89 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 200 len: 1538 microversion: 2.1 time: 0.148352 Apr 12 08:09:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 329/986] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:09:58 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 1538 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] Creating event network-changed:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:10:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-08f8a073-8a39-4ac7-a6c7-69f331daa17b req-2175e0e4-3e85-43b1-b66f-b1090b13829b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039376 Apr 12 08:10:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 330/987] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=10 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8255ab1c-52c3-4e07-82d7-d73ec99b20f3"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:00 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:00 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4c7b233e-baa7-46ad-8fd2-8d5c8bd4b88e tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302263 Apr 12 08:10:00 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 329/988] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:10:00 2023] POST /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:09 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'services' on Instance uuid 43d46682-0451-46c3-88f7-4dd09d0cd4e9 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:10:09 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-d6458411-f01c-4fed-9603-bb3ef78319ba tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments/8255ab1c-52c3-4e07-82d7-d73ec99b20f3" status: 202 len: 0 microversion: 2.1 time: 0.164855 Apr 12 08:10:09 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 330/989] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:10:09 2023] DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments/8255ab1c-52c3-4e07-82d7-d73ec99b20f3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:09 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:09 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-54fae21a-4d29-476e-bd77-a6ff16cd5ffd tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Apr 12 08:10:09 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 331/990] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:10:09 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:10:15 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:10:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f2342b65-e2bc-4fd9-9344-fe2739a89c57 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1654 microversion: 2.20 time: 0.203622 Apr 12 08:10:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 330/991] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:10:15 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1654 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:10:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:10:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-06abac80-202a-49a7-a907-b17f5aaae343 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050142 Apr 12 08:10:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 331/992] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:10:59 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1356949786"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-dafca234-5375-4045-aaac-01711dfff770 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/action" status: 202 len: 0 microversion: 2.1 time: 0.836031 Apr 12 08:11:03 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 332/993] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 08:11:02 2023] POST /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1086621763", "imageRef": "5849deaf-c4ba-409a-b228-b19d3ac3cca8", "flavorRef": "42", "key_name": "tempest-TestStampPattern-598492705", "security_groups": [{"name": "tempest-secgroup-smoke-194245248"}], "networks": [{"uuid": "04a0ab6e-5794-4409-9c51-d6debd57a18b"}]}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] validate_networks() for [('04a0ab6e-5794-4409-9c51-d6debd57a18b', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Getting quotas for user 97536e3b50284fbc81a9188166e90a7a and project d2abfb00bf93470c9e71aa01f477ccf7. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:11:11 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5849deaf-c4ba-409a-b228-b19d3ac3cca8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:11:11 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-359b7a46-836b-49f5-b057-c728640280c8 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.614795 Apr 12 08:11:11 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 331/994] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:11:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:11:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9c71d934-8264-4a93-b2df-2d4e2efe7197 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:11:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9c71d934-8264-4a93-b2df-2d4e2efe7197 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:11:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:11 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:11 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-9c71d934-8264-4a93-b2df-2d4e2efe7197 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:11:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9c71d934-8264-4a93-b2df-2d4e2efe7197 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 200 len: 1236 microversion: 2.1 time: 0.120802 Apr 12 08:11:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 332/995] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:11:11 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 1236 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:14 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] Creating event network-changed:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:11:14 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-0747b016-5130-458a-9a8e-06811064ddeb req-9a1805f8-871d-4d6a-8efd-2bd74aab164d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059984 Apr 12 08:11:14 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 333/996] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf45fc6-227c-4f48-8bd7-36232092aa61"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:15 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:15 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-16d29b89-5edf-4de2-b768-4cea302c727f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284279 Apr 12 08:11:15 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 332/997] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 08:11:15 2023] POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:15 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72697) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 08:11:15 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-34d70010-ebee-4a77-bd72-4f127cf70c18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/action" status: 202 len: 0 microversion: 2.20 time: 0.123535 Apr 12 08:11:15 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 333/998] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:11:15 2023] POST /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:11:16 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:11:16 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-2e1279eb-4fef-4a04-a006-1159df4481a2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1740 microversion: 2.20 time: 0.160052 Apr 12 08:11:16 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 334/999] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:11:16 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:11:16 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "name": "network-vif-plugged", "status": "completed", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:16 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] Creating event network-vif-plugged:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:11:16 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-e3a2ed43-5eea-4aba-876a-a783d93e5b11 req-b0ea898a-92ac-436c-b192-49f608037829 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049236 Apr 12 08:11:16 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 333/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:11:18 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "name": "network-vif-plugged", "status": "completed", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:18 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] Creating event network-vif-plugged:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:11:18 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-a0312dfa-439d-4232-adf9-67e7896192e7 req-ae2be7fd-243d-488b-a571-f4bf940cebcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 Apr 12 08:11:18 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 334/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:11:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] Creating event network-changed:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:11:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3f9d68e1-c8d3-47b4-8ea4-62bed6a68464 req-4c90e557-dcda-491d-b578-77c01c5db935 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031273 Apr 12 08:11:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 335/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:11:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-3c96b24b-364e-4eab-9520-611a5bdd19cc req-a97924be-9086-485c-a67d-4d9a294f0aec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059247 Apr 12 08:11:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 334/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:11:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:11:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:11:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-644848e6-1d7d-4bbf-9cef-deed2478b598 req-31e95f3d-5825-4e10-b6f8-0b04f44568dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050792 Apr 12 08:11:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 335/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:12:01 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:12:01 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4c4c8998-bec2-41bb-b8dc-b32084caad78 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 200 len: 1537 microversion: 2.1 time: 0.150353 Apr 12 08:12:01 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 336/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:12:01 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:12:06 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:12:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e637fbbe-5572-42e8-92bf-6241f781b1c4 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1785 microversion: 2.20 time: 0.242012 Apr 12 08:12:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 335/1006] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:12:06 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1785 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:13:02 user devstack@n-api.service[72697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:02 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:13:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-3e331d85-e991-4cc1-aebd-8c43e3ddaf3c tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 200 len: 1537 microversion: 2.1 time: 0.194833 Apr 12 08:13:02 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 336/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:13:02 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:04 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] Creating event network-changed:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:13:04 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-4184a203-6113-4b9b-a699-19c27db9b1e6 req-c8e0c217-afd0-4434-b63b-1658cadf9d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154755 Apr 12 08:13:04 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 337/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-fa6f334d-89c1-49fa-be1f-356c8bf0e636 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450857 Apr 12 08:13:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 336/1009] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:13:04 2023] POST /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:13:06 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33458. Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-e0f10202-2b9e-4eeb-9104-65583d8bd5aa tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments/fcf45fc6-227c-4f48-8bd7-36232092aa61" status: 200 len: 194 microversion: 2.20 time: 0.162830 Apr 12 08:13:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 337/1010] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 08:13:06 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments/fcf45fc6-227c-4f48-8bd7-36232092aa61 => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:06 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'services' on Instance uuid 16df9bdc-e946-4d1b-be3c-d460123b0fa5 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:13:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-264ba51a-0fc4-4138-9dfb-2e43d52e391a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments/fcf45fc6-227c-4f48-8bd7-36232092aa61" status: 202 len: 0 microversion: 2.20 time: 0.263739 Apr 12 08:13:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 338/1011] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 08:13:06 2023] DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments/fcf45fc6-227c-4f48-8bd7-36232092aa61 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8e64d67f-2929-4dc0-978c-3e898ca9b63f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052052 Apr 12 08:13:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 337/1012] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 08:13:07 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:11 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lazy-loading 'services' on Instance uuid 0c151ba7-5711-44f0-aa2a-10b26dc77474 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:13:11 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6962de6d-01d3-4985-83c4-d929d118b2c0 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments/563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4" status: 202 len: 0 microversion: 2.1 time: 0.215533 Apr 12 08:13:11 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:13:11 2023] DELETE /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments/563187bd-ef50-43ea-a6d7-9c4e0a0e9ce4 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:11 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:11 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b7c4105d-17cd-4161-8b86-b0c2789fa4d7 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Apr 12 08:13:11 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 339/1014] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:13:11 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-834d566f-144e-4f60-b080-9292f468ad32 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052999 Apr 12 08:13:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 338/1015] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 08:13:57 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:13:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6aaea054-55e6-4b84-8a3b-e6a1137e20a7 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 204 len: 0 microversion: 2.20 time: 0.132546 Apr 12 08:13:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 339/1016] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:13:57 2023] DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:13:57 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:13:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-1f13eb26-c32e-4fd7-bc1e-7e9b4a09e17e tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 200 len: 1713 microversion: 2.20 time: 0.241134 Apr 12 08:13:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 340/1017] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:13:57 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 1713 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] Creating event network-vif-unplugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:13:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-02d5ae23-5efd-4c43-9e39-6f97d88e4d4e req-58fef99b-54fc-4c66-8994-01ffb5cb57b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032687 Apr 12 08:13:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 339/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:13:59 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-deleted", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:13:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:59 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] Creating event network-vif-deleted:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:13:59 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-0e03b462-e108-4da8-b485-e05242bb6d10 req-7f255786-4513-4fe1-8027-eb30d7bdca4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089857 Apr 12 08:13:59 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 340/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:13:59 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df9bdc-e946-4d1b-be3c-d460123b0fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c52a7d72-ce8f-4795-ae56-6b9ec9366f0a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:13:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:13:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:13:59 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:13:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] Creating event network-vif-plugged:c52a7d72-ce8f-4795-ae56-6b9ec9366f0a for instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 on user Apr 12 08:13:59 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-3956b212-a677-49df-b195-674c0e19146f req-b174309e-6d8e-4466-b64f-5ca4a8c792fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 Apr 12 08:13:59 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 341/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:01 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:01 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b12399dc-5c31-4144-8a0f-c81703789c67 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054263 Apr 12 08:14:01 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 340/1021] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:14:01 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] Creating event network-changed:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:14:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-f691b32d-2a25-44ac-95b9-c54be9657c29 req-de5b320b-0358-47f3-921f-35f4c44afda9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029005 Apr 12 08:14:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 342/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:02 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:14:02 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-54fa2d19-2b76-4b15-82a7-fbfc37329eb5 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 204 len: 0 microversion: 2.1 time: 0.116651 Apr 12 08:14:02 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 341/1023] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:14:02 2023] DELETE /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:14:02 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8a8c2b08-6d86-4523-b90e-cb907cac4681 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 200 len: 1662 microversion: 2.1 time: 0.222299 Apr 12 08:14:02 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 341/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:14:02 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 1662 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "name": "network-vif-unplugged", "status": "completed", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:02 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] Creating event network-vif-unplugged:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:14:02 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-8eeb7528-51c2-48e8-a15f-c79d32cfa1a4 req-9f9a2ba7-18fc-4cfa-ad26-447ab79c35a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101412 Apr 12 08:14:02 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 343/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 08:14:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "name": "network-vif-deleted", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:03 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] Creating event network-vif-deleted:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:14:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-9bb5f1ce-5c57-4994-a18e-5eb50cea2870 req-c4b4dbae-f9ac-4d11-a3c6-a68d09ba0672 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Apr 12 08:14:03 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 342/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:04 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c151ba7-5711-44f0-aa2a-10b26dc77474", "name": "network-vif-plugged", "status": "completed", "tag": "ee0639fa-801c-48ac-aa70-654e7f04ce3a"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:04 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] Creating event network-vif-plugged:ee0639fa-801c-48ac-aa70-654e7f04ce3a for instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 on user Apr 12 08:14:04 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-58e77ba6-698b-4b7a-b2a1-902b9f5199e1 req-2b13bb45-f0da-47f2-b3d9-3158109d5e95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029611 Apr 12 08:14:04 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 342/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=8 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=12 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:47 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:14:47 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 HTTP/1.1 Apr 12 08:14:47 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:14:47 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:14:47 user devstack@n-api.service[72695]: Connection: close Apr 12 08:14:47 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:14:47 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:14:47 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:14:47 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:14:47 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:14:47 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:14:47 user devstack@n-api.service[72695]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:14:47 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:14:47 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:14:47 user devstack@n-api.service[72695]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:14:47 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:14:47 user devstack@n-api.service[72695]: method: > Apr 12 08:14:47 user devstack@n-api.service[72695]: exception: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:14:47 user devstack@n-api.service[72695]: action_args: {'id': '16df9bdc-e946-4d1b-be3c-d460123b0fa5'} Apr 12 08:14:47 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:14:47 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:47 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:14:47 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d890c0ec-56a3-4148-87c9-026f95a351f9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 404 len: 111 microversion: 2.20 time: 0.076918 Apr 12 08:14:47 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 344/1028] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:14:47 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:14:47 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:47 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:47 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8167f977-8101-442d-8ea0-8a64db2b15dd tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '.version_select at 0x7f7c05faf910>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8167f977-8101-442d-8ea0-8a64db2b15dd tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482956523" status: 204 len: 0 microversion: 2.20 time: 0.038293 Apr 12 08:14:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 343/1029] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 08:14:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482956523 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:14:48 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=10 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:48 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=22 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-d0b36f2f-e515-4b93-b2b6-a94086fdb79b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: .version_select at 0x7f7c051cfeb0>, body: {"keypair": {"name": "tempest-keypair-1362819448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1177QTZ6MOY/ghf5gm4WSJ+rW3qHfiCub3ZmOIsRJl6gDzY3JWjWt/0WwzyMHLZLZhU7VCJU3PZEivJ5/58oTtdiMBwCkXNtMnr8epnanBcFIAxd8nh14cO/1ziLz65w=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:48 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-d0b36f2f-e515-4b93-b2b6-a94086fdb79b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:14:48 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-d0b36f2f-e515-4b93-b2b6-a94086fdb79b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for user 705c265380f543848a986352fa2e385c and project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:14:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-d0b36f2f-e515-4b93-b2b6-a94086fdb79b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.092839 Apr 12 08:14:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 343/1030] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 08:14:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1054995483", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "008fc615-654d-414f-bc6f-fe11af903e1f"}], "security_groups": [{"name": "tempest-securitygroup--890385580"}], "key_name": "tempest-keypair-1362819448", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] validate_networks() for [('008fc615-654d-414f-bc6f-fe11af903e1f', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Getting quotas for user 705c265380f543848a986352fa2e385c and project 0eca5169ebeb49208b99a1aba27b8f2d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:14:50 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:14:50 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a1dfe9c0-1f99-4826-8a26-f6a6987fcf9a tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.679669 Apr 12 08:14:50 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 345/1031] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 08:14:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 08:14:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:50 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:50 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:14:50 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:14:50 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:14:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a416f67a-b99a-449f-af39-8de8fa820d56 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1276 microversion: 2.20 time: 0.081571 Apr 12 08:14:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 344/1032] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:14:50 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 0c151ba7-5711-44f0-aa2a-10b26dc77474] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:52 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] HTTP exception thrown: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Request method failure captured: Apr 12 08:14:52 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 HTTP/1.1 Apr 12 08:14:52 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:14:52 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:14:52 user devstack@n-api.service[72696]: Connection: close Apr 12 08:14:52 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:14:52 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:14:52 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:14:52 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:14:52 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmbexgJkvYRCfkN3HhL9i-8aH08UJfHg8nn0eSWylbx87PAjC4r-c7hCEn4n43QzS-zQhIAkxsdh1g7B9s_4KhNTqwuTY4bhqPpt-yMeSqu1JDgbh2ruZKIWbAXrAHstxiUte21PQAWXUDOLVSS6T3AM63JUS33acrPtCyV8wz1xu_M Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Project-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestStampPattern-1602124066 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Tenant: tempest-TestStampPattern-1602124066 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Tenant-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestStampPattern-1602124066 Apr 12 08:14:52 user devstack@n-api.service[72696]: X-User: tempest-TestStampPattern-1602124066-project-member Apr 12 08:14:52 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:14:52 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:14:52 user devstack@n-api.service[72696]: X-User-Id: 97536e3b50284fbc81a9188166e90a7a Apr 12 08:14:52 user devstack@n-api.service[72696]: X-User-Name: tempest-TestStampPattern-1602124066-project-member Apr 12 08:14:52 user devstack@n-api.service[72696]: method: > Apr 12 08:14:52 user devstack@n-api.service[72696]: exception: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. Apr 12 08:14:52 user devstack@n-api.service[72696]: action_args: {'id': '0c151ba7-5711-44f0-aa2a-10b26dc77474'} Apr 12 08:14:52 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. Apr 12 08:14:52 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:14:52 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Returning 404 to user: Instance 0c151ba7-5711-44f0-aa2a-10b26dc77474 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:14:52 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-81557c25-1f50-4288-9c2c-d9c240954ebc tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474" status: 404 len: 111 microversion: 2.1 time: 0.029573 Apr 12 08:14:52 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 344/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:14:52 2023] GET /compute/v2.1/servers/0c151ba7-5711-44f0-aa2a-10b26dc77474 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 08:14:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] Creating event network-changed:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:14:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-05d02627-7440-4c2c-ace1-679be914a37c req-69208470-9c77-4f0e-b6fb-78f5433244c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031240 Apr 12 08:14:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 346/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:55 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:55 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:14:55 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-20c4cbdb-8d26-4f96-b462-0d74cff2fa47 req-626bb5f1-622e-4b44-ae20-502220c694c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Apr 12 08:14:55 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 345/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:14:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-cbb1ead6-f6b2-4b0f-b386-144394556b6f req-e0b76135-9488-470f-b489-3c85def3b915 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 Apr 12 08:14:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 345/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] HTTP exception thrown: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 is not attached to volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Request method failure captured: Apr 12 08:14:57 user devstack@n-api.service[72695]: request: DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments/8255ab1c-52c3-4e07-82d7-d73ec99b20f3 HTTP/1.1 Apr 12 08:14:57 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:14:57 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:14:57 user devstack@n-api.service[72695]: Connection: close Apr 12 08:14:57 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:14:57 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:14:57 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:14:57 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:14:57 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmbexgJkvYRCfkN3HhL9i-8aH08UJfHg8nn0eSWylbx87PAjC4r-c7hCEn4n43QzS-zQhIAkxsdh1g7B9s_4KhNTqwuTY4bhqPpt-yMeSqu1JDgbh2ruZKIWbAXrAHstxiUte21PQAWXUDOLVSS6T3AM63JUS33acrPtCyV8wz1xu_M Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Project-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Project-Name: tempest-TestStampPattern-1602124066 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Tenant: tempest-TestStampPattern-1602124066 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Tenant-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-TestStampPattern-1602124066 Apr 12 08:14:57 user devstack@n-api.service[72695]: X-User: tempest-TestStampPattern-1602124066-project-member Apr 12 08:14:57 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:14:57 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:14:57 user devstack@n-api.service[72695]: X-User-Id: 97536e3b50284fbc81a9188166e90a7a Apr 12 08:14:57 user devstack@n-api.service[72695]: X-User-Name: tempest-TestStampPattern-1602124066-project-member Apr 12 08:14:57 user devstack@n-api.service[72695]: method: > Apr 12 08:14:57 user devstack@n-api.service[72695]: exception: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 is not attached to volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 Apr 12 08:14:57 user devstack@n-api.service[72695]: action_args: {'server_id': '43d46682-0451-46c3-88f7-4dd09d0cd4e9', 'id': '8255ab1c-52c3-4e07-82d7-d73ec99b20f3'} Apr 12 08:14:57 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8255ab1c-52c3-4e07-82d7-d73ec99b20f3. Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 is not attached to volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 is not attached to volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 Apr 12 08:14:57 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:14:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Returning 404 to user: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 is not attached to volume 8255ab1c-52c3-4e07-82d7-d73ec99b20f3 {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:14:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-8a3b0e5c-55f2-4470-9104-d0bc8d6e4a50 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments/8255ab1c-52c3-4e07-82d7-d73ec99b20f3" status: 404 len: 154 microversion: 2.1 time: 0.105750 Apr 12 08:14:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 347/1037] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:14:57 2023] DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9/os-volume_attachments/8255ab1c-52c3-4e07-82d7-d73ec99b20f3 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] Creating event network-changed:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:14:58 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-f1a7a4da-98de-4b7f-b23e-ceab63d3be3d req-5580d764-72a4-4c76-a856-ca7ee4a6edce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031451 Apr 12 08:14:58 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 346/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:14:58 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:14:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-6db96bd4-a436-4d47-8f9f-2228a79ca7c2 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 204 len: 0 microversion: 2.1 time: 0.127866 Apr 12 08:14:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 346/1039] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:14:58 2023] DELETE /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:58 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97536e3b50284fbc81a9188166e90a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2abfb00bf93470c9e71aa01f477ccf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:14:58 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d487276c-de0b-4dc4-9ae3-13d0773b8675 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 200 len: 1662 microversion: 2.1 time: 0.230707 Apr 12 08:14:58 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 348/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:14:58 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 1662 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:14:59 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:14:59 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "name": "network-vif-deleted", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:14:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:14:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:14:59 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:14:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] Creating event network-vif-deleted:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:14:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-c91a96e8-d21e-4ea4-9956-13d72e50e041 req-f19efdcc-e407-41ed-9007-2edbd814a6a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041260 Apr 12 08:14:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 347/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:15:00 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "name": "network-vif-unplugged", "status": "completed", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}, {"server_uuid": "43d46682-0451-46c3-88f7-4dd09d0cd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "3b60e3e3-a92c-40bb-bed4-796cdbd6074e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:15:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:15:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:15:00 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:15:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Creating event network-vif-unplugged:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:15:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] Creating event network-vif-plugged:3b60e3e3-a92c-40bb-bed4-796cdbd6074e for instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 on user Apr 12 08:15:00 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-14ebda7d-7ecf-4e53-b9a8-165f41a54752 req-070776fd-153b-46be-a3c1-13ee9254da34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034535 Apr 12 08:15:00 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 347/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:40 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:15:40 user devstack@n-api.service[72695]: Wed Apr 12 08:15:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 (ip 10.0.0.210) !!! Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=18 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:15:40 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:15:41 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:15:41 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:15:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4445215b-f8cf-4509-a004-eede0f52e29b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1586 microversion: 2.20 time: 0.198232 Apr 12 08:15:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 349/1043] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:15:40 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1586 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:15:48 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:15:48 user devstack@n-api.service[72696]: Wed Apr 12 08:15:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 (ip 10.0.0.210) !!! Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] [instance: 43d46682-0451-46c3-88f7-4dd09d0cd4e9] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:15:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] HTTP exception thrown: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Request method failure captured: Apr 12 08:15:48 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 HTTP/1.1 Apr 12 08:15:48 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:15:48 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:15:48 user devstack@n-api.service[72696]: Connection: close Apr 12 08:15:48 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:15:48 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:15:48 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:15:48 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:15:48 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmbexgJkvYRCfkN3HhL9i-8aH08UJfHg8nn0eSWylbx87PAjC4r-c7hCEn4n43QzS-zQhIAkxsdh1g7B9s_4KhNTqwuTY4bhqPpt-yMeSqu1JDgbh2ruZKIWbAXrAHstxiUte21PQAWXUDOLVSS6T3AM63JUS33acrPtCyV8wz1xu_M Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Project-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Project-Name: tempest-TestStampPattern-1602124066 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2abfb00bf93470c9e71aa01f477ccf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Tenant: tempest-TestStampPattern-1602124066 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Tenant-Id: d2abfb00bf93470c9e71aa01f477ccf7 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-TestStampPattern-1602124066 Apr 12 08:15:48 user devstack@n-api.service[72696]: X-User: tempest-TestStampPattern-1602124066-project-member Apr 12 08:15:48 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:15:48 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:15:48 user devstack@n-api.service[72696]: X-User-Id: 97536e3b50284fbc81a9188166e90a7a Apr 12 08:15:48 user devstack@n-api.service[72696]: X-User-Name: tempest-TestStampPattern-1602124066-project-member Apr 12 08:15:48 user devstack@n-api.service[72696]: method: > Apr 12 08:15:48 user devstack@n-api.service[72696]: exception: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. Apr 12 08:15:48 user devstack@n-api.service[72696]: action_args: {'id': '43d46682-0451-46c3-88f7-4dd09d0cd4e9'} Apr 12 08:15:48 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. Apr 12 08:15:48 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:15:48 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Returning 404 to user: Instance 43d46682-0451-46c3-88f7-4dd09d0cd4e9 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:15:48 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e566bf9e-0e58-4ce8-bf9e-123562c255b1 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9" status: 404 len: 111 microversion: 2.1 time: 0.043801 Apr 12 08:15:48 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 348/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:15:48 2023] GET /compute/v2.1/servers/43d46682-0451-46c3-88f7-4dd09d0cd4e9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:15:51 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:51 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:15:51 user devstack@n-api.service[72697]: Wed Apr 12 08:15:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestStampPattern-598492705 (ip 10.0.0.210) !!! Apr 12 08:15:51 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:51 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:15:51 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-38314824-4484-400d-95be-b4ad1292d4a3 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] Calling method '.version_select at 0x7f7c0520aa70>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:15:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-38314824-4484-400d-95be-b4ad1292d4a3 tempest-TestStampPattern-1602124066 tempest-TestStampPattern-1602124066-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-598492705" status: 202 len: 0 microversion: 2.1 time: 0.041929 Apr 12 08:15:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 348/1045] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 08:15:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-598492705 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-923e8053-2d2c-4a9f-81c4-15742d024aff tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.105453 Apr 12 08:16:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 350/1046] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 08:16:41 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-interface => generated 282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:16:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:16:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:16:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] Creating event network-changed:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:16:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-6a6a463e-c90e-4c61-8407-715e3a9e241e req-c0445ec9-6655-4a1d-a242-82058fe7bbc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033784 Apr 12 08:16:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 349/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-bd865efe-3e91-440b-b012-51104238f4c9 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/ips" status: 200 len: 109 microversion: 2.20 time: 0.044116 Apr 12 08:16:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 349/1048] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 08:16:41 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:43 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lazy-loading 'flavor' on Instance uuid c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:16:44 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f8809a23-bb20-478c-a5b9-3d60cd76adf5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/action" status: 202 len: 0 microversion: 2.20 time: 0.913522 Apr 12 08:16:44 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 351/1049] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:16:43 2023] POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/action => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:44 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-unplugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:16:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:44 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] Creating event network-vif-unplugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:16:44 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-8eff74a5-f496-46ce-9eeb-d50290b56885 req-956ad67c-4c1e-4b53-90c8-9f565d649153 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030938 Apr 12 08:16:44 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 350/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:16:44 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:16:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8e9fb8ad-181a-4426-8ee7-d8f51c3d23d5 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1711 microversion: 2.20 time: 0.343861 Apr 12 08:16:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 350/1051] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:16:44 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1711 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:16:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:16:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:16:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-bd548a12-e141-4331-ac92-0e2100cd3b6d req-bb6d2e99-606b-4372-9a2a-96027582d75e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Apr 12 08:16:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 352/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:16:48 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:16:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:16:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:16:48 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:16:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] Creating event network-changed:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:16:48 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-5af3770e-7eed-48e2-b7c2-0a9908aca02b req-b18110ed-7448-41db-84bd-2090f9f3a050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030400 Apr 12 08:16:48 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 351/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:16:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:17:34 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:17:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e19b4831-4009-4daf-8df1-9320a3d50bb2 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1652 microversion: 2.20 time: 0.143646 Apr 12 08:17:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 351/1054] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:17:34 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:18:34 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:34 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90af7f6d-c5f2-4b7e-8e97-dd0c27f88dfc"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:35 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:35 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-615d6ebe-8932-4d7b-b1e9-71146d223356 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.581253 Apr 12 08:18:35 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 353/1055] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 08:18:34 2023] POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments => generated 188 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 08:18:35 user devstack@n-api.service[72697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:18:35 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:18:35 user devstack@n-api.service[72697]: Wed Apr 12 08:18:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments/90af7f6d-c5f2-4b7e-8e97-dd0c27f88dfc (ip 10.0.0.210) !!! Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:35 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:35 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-2637098a-d846-450f-a41c-bb8157fa6010 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments/90af7f6d-c5f2-4b7e-8e97-dd0c27f88dfc" status: 202 len: 0 microversion: 2.20 time: 0.300271 Apr 12 08:18:35 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 352/1056] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 08:18:35 2023] DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments/90af7f6d-c5f2-4b7e-8e97-dd0c27f88dfc => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:18:35 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:35 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:36 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72696) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 08:18:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-a079b1d2-9f6c-4312-a986-865e6e58840b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/action" status: 202 len: 0 microversion: 2.20 time: 0.197892 Apr 12 08:18:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 352/1057] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 08:18:35 2023] POST /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:18:36 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:18:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0760a577-38c5-4d48-b9c9-4d75b4db8817 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1660 microversion: 2.20 time: 0.162381 Apr 12 08:18:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 354/1058] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:18:36 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1660 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:18:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:18:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] Creating event network-changed:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:18:38 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 48686. Apr 12 08:18:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-2eb637fd-f37f-40c6-9f1d-ad38c78513e2 req-10c9513c-8ad7-48de-b48a-d12bcb0b9949 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035225 Apr 12 08:18:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 353/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:18:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:18:44 user devstack@n-api.service[72696]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f464210b-97e7-4b71-a0ad-5f7b5f8f8cdf] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:18:44 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:18:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:44 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:18:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-80631227-cba4-4e46-ae75-c5c8cc508341 req-5bb25f21-13ba-4807-97f8-eae784e6fe84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048615 Apr 12 08:18:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 353/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:18:46 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:18:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:18:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:18:46 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:18:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:18:46 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-53429ca8-eda5-43f3-8d05-da4a37915d16 req-2eb086bc-d277-4920-8946-cdb8db590b04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035614 Apr 12 08:18:46 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 355/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:18:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:19:26 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:19:26 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8424d8f4-d305-4f0d-a33f-56c0437215ed tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1705 microversion: 2.20 time: 0.217392 Apr 12 08:19:26 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 354/1062] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:19:26 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1705 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:20:26 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:20:26 user devstack@n-api.service[72696]: Wed Apr 12 08:20:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:26 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] [f464210b-97e7-4b71-a0ad-5f7b5f8f8cdf] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58246. Apr 12 08:20:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4d44eafc-4804-49b3-9965-a0db6d908b3f tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071779 Apr 12 08:20:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 354/1063] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 08:20:26 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:20:26 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:20:26 user devstack@n-api.service[72695]: Wed Apr 12 08:20:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 (ip 10.0.0.210) !!! Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:27 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:20:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-4b083fc2-7e74-405d-8ce4-1f600bf1c852 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 204 len: 0 microversion: 2.20 time: 0.156765 Apr 12 08:20:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 356/1064] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:20:26 2023] DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:20:27 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '705c265380f543848a986352fa2e385c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca5169ebeb49208b99a1aba27b8f2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:20:27 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-dc59c802-7928-47c0-bd12-92f7faa7108b tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 200 len: 1711 microversion: 2.20 time: 0.244316 Apr 12 08:20:27 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 355/1065] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:20:27 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 1711 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 08:20:27 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-unplugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:20:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:27 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] Creating event network-vif-unplugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:27 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-fa47a898-fed1-4d39-928a-ddabc2457231 req-2357cd65-5534-44c3-92b8-120db76dc21b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151306 Apr 12 08:20:27 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 355/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:20:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:20:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}, {"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}, {"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}, {"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-unplugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}, {"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-plugged", "status": "completed", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:20:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Creating event network-vif-unplugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] Creating event network-vif-plugged:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:29 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-bf7c5761-6f72-4eea-8421-c2af5a45ee91 req-15b24145-010d-4526-8ed8-ad8b39817301 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037144 Apr 12 08:20:29 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 357/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:20:31 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ac230-4a78-4cae-a6e8-6a2b97c0fe25", "name": "network-vif-deleted", "tag": "a0a795c9-9852-407c-86c0-713846c39f6c"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:20:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:20:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:20:31 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:20:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] Creating event network-vif-deleted:a0a795c9-9852-407c-86c0-713846c39f6c for instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 on user Apr 12 08:20:31 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-c716dd2b-a493-4ef7-a030-56f5e85c5e36 req-643a3a10-ba85-447c-829c-03f4e2306a3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052372 Apr 12 08:20:31 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 356/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:17 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 08:21:17 user devstack@n-api.service[72696]: Wed Apr 12 08:21:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 (ip 10.0.0.210) !!! Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:21:17 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 HTTP/1.1 Apr 12 08:21:17 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:21:17 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:21:17 user devstack@n-api.service[72696]: Connection: close Apr 12 08:21:17 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:21:17 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:21:17 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:21:17 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:21:17 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:17 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:17 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:17 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:21:17 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:21:17 user devstack@n-api.service[72696]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:21:17 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:17 user devstack@n-api.service[72696]: method: > Apr 12 08:21:17 user devstack@n-api.service[72696]: exception: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:17 user devstack@n-api.service[72696]: action_args: {'id': 'c10ac230-4a78-4cae-a6e8-6a2b97c0fe25'} Apr 12 08:21:17 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:17 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:17 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:21:17 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-afc82f5c-dbd4-4b60-8032-22faf8bcf0fb tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 404 len: 111 microversion: 2.20 time: 0.045038 Apr 12 08:21:17 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 356/1069] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:21:17 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:21:17 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:17 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:17 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 08:21:17 user devstack@n-api.service[72695]: Wed Apr 12 08:21:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1362819448 (ip 10.0.0.210) !!! Apr 12 08:21:17 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-64725c65-10ae-4081-8f97-d8cef1e5a825 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '.version_select at 0x7f7c04f21bd0>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:17 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-64725c65-10ae-4081-8f97-d8cef1e5a825 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362819448" status: 204 len: 0 microversion: 2.20 time: 0.059834 Apr 12 08:21:17 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 358/1070] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 08:21:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362819448 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:21:20 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 HTTP/1.1 Apr 12 08:21:20 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:21:20 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:21:20 user devstack@n-api.service[72697]: Connection: close Apr 12 08:21:20 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:21:20 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:21:20 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:21:20 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:21:20 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:20 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:20 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:21:20 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:21:20 user devstack@n-api.service[72697]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:21:20 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:20 user devstack@n-api.service[72697]: method: > Apr 12 08:21:20 user devstack@n-api.service[72697]: exception: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72697]: action_args: {'id': 'c10ac230-4a78-4cae-a6e8-6a2b97c0fe25'} Apr 12 08:21:20 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:21:20 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-91edd025-01dc-4f1d-b1c1-64ac89b76824 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 404 len: 111 microversion: 2.20 time: 0.040745 Apr 12 08:21:20 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 357/1071] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:21:20 2023] DELETE /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: c10ac230-4a78-4cae-a6e8-6a2b97c0fe25] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:21:20 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 HTTP/1.1 Apr 12 08:21:20 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:21:20 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:21:20 user devstack@n-api.service[72696]: Connection: close Apr 12 08:21:20 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:21:20 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:21:20 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:21:20 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:21:20 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:20 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:20 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:20 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:21:20 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:21:20 user devstack@n-api.service[72696]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:21:20 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:20 user devstack@n-api.service[72696]: method: > Apr 12 08:21:20 user devstack@n-api.service[72696]: exception: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72696]: action_args: {'id': 'c10ac230-4a78-4cae-a6e8-6a2b97c0fe25'} Apr 12 08:21:20 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. Apr 12 08:21:20 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:21:20 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:21:20 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e464c16a-525e-4599-a870-50942e911859 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25" status: 404 len: 111 microversion: 2.20 time: 0.031079 Apr 12 08:21:20 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 357/1072] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:21:20 2023] GET /compute/v2.1/servers/c10ac230-4a78-4cae-a6e8-6a2b97c0fe25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:21:22 user devstack@n-api.service[72695]: request: DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 HTTP/1.1 Apr 12 08:21:22 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:21:22 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:21:22 user devstack@n-api.service[72695]: Connection: close Apr 12 08:21:22 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:21:22 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:21:22 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:21:22 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:21:22 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:22 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72695]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:22 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:21:22 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:21:22 user devstack@n-api.service[72695]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:21:22 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:22 user devstack@n-api.service[72695]: method: > Apr 12 08:21:22 user devstack@n-api.service[72695]: exception: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72695]: action_args: {'id': '16df9bdc-e946-4d1b-be3c-d460123b0fa5'} Apr 12 08:21:22 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:21:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b407d998-9416-4c85-816a-e1bbe858be18 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 404 len: 111 microversion: 2.20 time: 0.041324 Apr 12 08:21:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 359/1073] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 08:21:22 2023] DELETE /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] [instance: 16df9bdc-e946-4d1b-be3c-d460123b0fa5] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] HTTP exception thrown: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Request method failure captured: Apr 12 08:21:22 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 HTTP/1.1 Apr 12 08:21:22 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:21:22 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:21:22 user devstack@n-api.service[72697]: Connection: close Apr 12 08:21:22 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:21:22 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:21:22 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:21:22 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:21:22 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmbAqmNMbGwfbDUxhUJkf2yf5Sb94OrKbz_nRgJhNQ1N0SSAYR2FaVJQyOCl8yMW2f2XyqhtpxeIGuvj6DozTgmu5yJUzr3l9VCKZLEOwx6xm39q-Uyw8gmbQBn4bT9Jvr7jTwkqwqi6MmlfXeQNKqNUkkYa_JOciaR9j60V2qxZw7I Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Project-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0eca5169ebeb49208b99a1aba27b8f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Tenant-Id: 0eca5169ebeb49208b99a1aba27b8f2d Apr 12 08:21:22 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1176597283 Apr 12 08:21:22 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:22 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:21:22 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:21:22 user devstack@n-api.service[72697]: X-User-Id: 705c265380f543848a986352fa2e385c Apr 12 08:21:22 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1176597283-project-member Apr 12 08:21:22 user devstack@n-api.service[72697]: method: > Apr 12 08:21:22 user devstack@n-api.service[72697]: exception: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72697]: action_args: {'id': '16df9bdc-e946-4d1b-be3c-d460123b0fa5'} Apr 12 08:21:22 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. Apr 12 08:21:22 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:21:22 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] Returning 404 to user: Instance 16df9bdc-e946-4d1b-be3c-d460123b0fa5 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:21:22 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-a7fee775-ef83-4164-9e55-a9628383beb6 tempest-AttachVolumeShelveTestJSON-1176597283 tempest-AttachVolumeShelveTestJSON-1176597283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5" status: 404 len: 111 microversion: 2.20 time: 0.030882 Apr 12 08:21:22 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 358/1074] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 08:21:22 2023] GET /compute/v2.1/servers/16df9bdc-e946-4d1b-be3c-d460123b0fa5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:21:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:34 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-8719d63a-3ad7-452b-96d7-b6d53fb943ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: .version_select at 0x7f7c052b3c70>, body: {"keypair": {"name": "tempest-keypair-177521254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm1iDAsrc5nn5HZ4c1S2/5BQYY9OlMCCqludw0R7nIsR4rOX1g1NGeT0qKEvePSLaBIvNw+MxhrHLfdqFpCA8NgOH4lVOQi4JLS7OyBU4zU694ItIO3yoJ/KXTGUqpZ2w=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:21:34 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-8719d63a-3ad7-452b-96d7-b6d53fb943ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:21:34 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-8719d63a-3ad7-452b-96d7-b6d53fb943ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:21:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-8719d63a-3ad7-452b-96d7-b6d53fb943ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202483 Apr 12 08:21:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 358/1075] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:21:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:21:35 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-285957137", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4602b19a-1eba-495e-be34-e3bd36c8e0b0"}], "security_groups": [{"name": "tempest-securitygroup--2100009098"}], "key_name": "tempest-keypair-177521254", "user_data": "}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:21:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:35 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:35 user devstack@n-api.service[72695]: DEBUG nova.network.neutron [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] validate_networks() for [('4602b19a-1eba-495e-be34-e3bd36c8e0b0', None, None, None, None, None)] {{(pid=72695) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.virt.hardware [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Going to run 1 instances... {{(pid=72695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:21:36 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:21:36 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-8bc410bf-c190-4fd4-b2e7-d9ca82b392b3 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.641603 Apr 12 08:21:36 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 360/1076] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:21:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:21:36 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-9474dcbb-a5ab-408c-b47a-69021517e03b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:21:36 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-9474dcbb-a5ab-408c-b47a-69021517e03b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:21:36 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:36 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:21:36 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-9474dcbb-a5ab-408c-b47a-69021517e03b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:21:36 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-9474dcbb-a5ab-408c-b47a-69021517e03b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 200 len: 1234 microversion: 2.1 time: 0.083280 Apr 12 08:21:36 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 359/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:21:36 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:21:38 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:21:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:38 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] Creating event network-changed:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:21:38 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-5c6e274a-128b-48b6-aff2-5c532bfcbd54 req-bcb8a883-7a16-4e6b-bbb9-514a33b4fb43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033955 Apr 12 08:21:38 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 359/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:21:40 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "name": "network-vif-plugged", "status": "completed", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:21:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:40 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] Creating event network-vif-plugged:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:21:40 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-cf1b1a22-5baa-4f27-b34d-2a055fabce59 req-2d01ea46-5ca5-4ed6-9200-39f5e728b14e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049408 Apr 12 08:21:40 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 361/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:21:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "name": "network-vif-plugged", "status": "completed", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:21:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:21:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:21:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:21:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] Creating event network-vif-plugged:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:21:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-be9101d6-4646-4c92-868c-4aab606639a9 req-a08c0031-84b5-4331-837d-43c5ad84bf8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029830 Apr 12 08:21:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 360/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:22:26 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:22:26 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-7c4c1c21-b811-47d1-bf3d-e1aedf6618bc tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 200 len: 1545 microversion: 2.1 time: 0.241368 Apr 12 08:22:26 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 360/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:22:26 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 1545 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:26 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:27 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-8a11cf16-3ba1-4df4-a65e-0ef5ab91f5f5 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.116005 Apr 12 08:23:27 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 362/1082] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 08:23:26 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-interface => generated 283 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:28 user devstack@n-api.service[72697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:28 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:23:28 user devstack@n-api.service[72697]: Wed Apr 12 08:23:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 08:23:28 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:23:28 user devstack@n-api.service[72697]: Wed Apr 12 08:23:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:28 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:28 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:28 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-22779109-a091-4e7d-8e20-f382dbb392ac tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/ips" status: 200 len: 109 microversion: 2.1 time: 0.045800 Apr 12 08:23:28 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 361/1083] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:23:28 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/ips => generated 109 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] Creating event network-changed:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:23:28 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-8e2c566a-6c8d-43b0-ad59-1b495b6e9668 req-a3e733d9-86c1-4619-95ad-3bc5ac7391f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124614 Apr 12 08:23:28 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 361/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe97f152-352e-43d2-aa94-a9ca218f0d59"}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:29 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-995bb7b7-2f94-44cc-8f65-4ca1c10b5597 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287183 Apr 12 08:23:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 363/1085] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:23:29 2023] POST /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:36 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-69b25fe3-e7c8-4875-9eee-37612de30b58 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: .version_select at 0x7f7c051ceef0>, body: {"keypair": {"name": "tempest-keypair-716215007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM9pCxMTupPC8FymhImlOExM/HKRPk9qsagDYN99/JZgzMwIXtfBgODpc4SRm1PWt/D7jiPoW0tGkXQQXpqC9+GF5bK7HDN/yYNePSjb82841cYQFaIblr5fyolkxL03A=="}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:36 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-69b25fe3-e7c8-4875-9eee-37612de30b58 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:23:36 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-69b25fe3-e7c8-4875-9eee-37612de30b58 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:23:36 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-69b25fe3-e7c8-4875-9eee-37612de30b58 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047431 Apr 12 08:23:36 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 362/1086] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:23:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-910312600", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4602b19a-1eba-495e-be34-e3bd36c8e0b0"}], "security_groups": [{"name": "tempest-securitygroup--2080338043"}], "key_name": "tempest-keypair-716215007", "user_data": "}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:38 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52992. Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.network.neutron [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] validate_networks() for [('4602b19a-1eba-495e-be34-e3bd36c8e0b0', None, None, None, None, None)] {{(pid=72697) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.virt.hardware [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.quota [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Going to run 1 instances... {{(pid=72697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:23:38 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:23:38 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-aeee720f-918e-44a3-858f-aafaf28ff1b8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.725368 Apr 12 08:23:38 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 362/1087] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:23:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:23:38 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9f865915-217d-4479-934a-64438bece617 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:23:38 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-9f865915-217d-4479-934a-64438bece617 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:23:38 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-9f865915-217d-4479-934a-64438bece617 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:23:38 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9f865915-217d-4479-934a-64438bece617 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 200 len: 1234 microversion: 2.1 time: 0.130063 Apr 12 08:23:38 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 364/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:23:38 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 1234 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:23:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] Creating event network-changed:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:23:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-0beaa205-5770-4f69-9814-1c051ba59b57 req-8d751e77-52f8-44c1-bc03-0a07df90a36f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038783 Apr 12 08:23:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 363/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] Creating event network-vif-plugged:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:23:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-c3858b0f-6c3a-4d27-9398-83a114f91945 req-26e1470b-67f9-44c7-b6a5-67e8643ed6cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084307 Apr 12 08:23:43 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 363/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:23:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:23:45 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:23:45 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:23:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:23:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:23:45 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:23:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] Creating event network-vif-plugged:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:23:45 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-98ecd762-535c-43bd-9a10-daf9698e6a24 req-7f20255f-0261-41a2-9b10-29b800042bfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035504 Apr 12 08:23:45 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 365/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:24:29 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:24:29 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-76c2c3e2-3bc2-4718-bc3e-e67b92aad5ea tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 200 len: 1544 microversion: 2.1 time: 0.251334 Apr 12 08:24:29 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 364/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:24:29 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 1544 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:29 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:29 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7865e558-9691-46a1-a36e-07e1b2975880 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.122505 Apr 12 08:25:29 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 364/1093] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 08:25:29 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/os-interface => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:25:30 user devstack@n-api.service[72695]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:30 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:25:30 user devstack@n-api.service[72695]: Wed Apr 12 08:25:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] Creating event network-changed:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:25:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-67a90cd1-9b0e-41ea-a331-a816b8e64f2b req-10414948-a69c-4958-92d7-8dec07cc391a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049908 Apr 12 08:25:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 366/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4f0c057f-6fdc-4f6f-b3b4-c1b1dff866fb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/ips" status: 200 len: 108 microversion: 2.1 time: 0.066118 Apr 12 08:25:30 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 365/1095] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:25:30 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/ips => generated 108 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe97f152-352e-43d2-aa94-a9ca218f0d59"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:25:30 user devstack@n-api.service[72697]: request: POST /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/os-volume_attachments HTTP/1.1 Apr 12 08:25:30 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:25:30 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:25:30 user devstack@n-api.service[72697]: Connection: close Apr 12 08:25:30 user devstack@n-api.service[72697]: Content-Length: 74 Apr 12 08:25:30 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:25:30 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:25:30 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:25:30 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:25:30 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:25:30 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:25:30 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:25:30 user devstack@n-api.service[72697]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:25:30 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:25:30 user devstack@n-api.service[72697]: Apr 12 08:25:30 user devstack@n-api.service[72697]: {"volumeAttachment": {"volumeId": "fe97f152-352e-43d2-aa94-a9ca218f0d59"}} Apr 12 08:25:30 user devstack@n-api.service[72697]: method: > Apr 12 08:25:30 user devstack@n-api.service[72697]: exception: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 Apr 12 08:25:30 user devstack@n-api.service[72697]: action_args: {'server_id': 'faec6a92-b2ab-44c3-a045-2c36968bc0a6', 'body': {'volumeAttachment': {'volumeId': 'fe97f152-352e-43d2-aa94-a9ca218f0d59'}}} Apr 12 08:25:30 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 Apr 12 08:25:30 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:25:30 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 400 to user: Invalid volume: volume fe97f152-352e-43d2-aa94-a9ca218f0d59 is already attached to instances: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:25:30 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-5a16372b-3d81-4ab8-a9ad-e3fb9ccf80c8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108649 Apr 12 08:25:30 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 365/1096] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:25:30 2023] POST /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:25:30 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-060fd425-ac74-4f51-a38b-b933be0c0123 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 204 len: 0 microversion: 2.1 time: 0.112691 Apr 12 08:25:30 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 367/1097] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:25:30 2023] DELETE /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:30 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:31 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:25:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-f91d0b09-3ac5-44c5-ac22-3b2620440884 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 200 len: 1550 microversion: 2.1 time: 0.190563 Apr 12 08:25:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 366/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:25:30 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:25:32 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "name": "network-vif-unplugged", "status": "completed", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}, {"server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:25:32 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faec6a92-b2ab-44c3-a045-2c36968bc0a6", "name": "network-vif-deleted", "tag": "3c8d20da-03b3-4b1e-93c5-341ee3072412"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:25:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:25:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:25:32 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:32 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:25:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] Creating event network-vif-deleted:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:25:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Creating event network-vif-unplugged:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:25:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] Creating event network-vif-plugged:3c8d20da-03b3-4b1e-93c5-341ee3072412 for instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 on user Apr 12 08:25:32 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-3972aab1-1383-4800-93a0-39f7dd4877f8 req-a6b25214-e124-46a4-8280-4bfcba8761f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085415 Apr 12 08:25:32 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 366/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:25:32 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-db44fe51-6be0-4f3e-af60-71abfd9618a6 req-ad9cec8d-1a09-4381-8fc4-fea77014f999 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038845 Apr 12 08:25:32 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 368/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=10 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:26:21 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 HTTP/1.1 Apr 12 08:26:21 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:26:21 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:26:21 user devstack@n-api.service[72696]: Connection: close Apr 12 08:26:21 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:26:21 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:26:21 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:26:21 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:26:21 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:26:21 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:26:21 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:26:21 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:26:21 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:26:21 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:26:21 user devstack@n-api.service[72696]: method: > Apr 12 08:26:21 user devstack@n-api.service[72696]: exception: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:26:21 user devstack@n-api.service[72696]: action_args: {'id': 'faec6a92-b2ab-44c3-a045-2c36968bc0a6'} Apr 12 08:26:21 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:26:21 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:26:21 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:26:21 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-3b5c4292-7c4d-49fa-8259-7f3179dab3bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 404 len: 111 microversion: 2.1 time: 0.038213 Apr 12 08:26:21 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:26:21 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:26:21 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=6 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:21 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=12 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:21 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-1f6a73c0-57ba-44a1-8f4a-9623b758cff2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '.version_select at 0x7f7bf47c2320>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:26:21 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-1f6a73c0-57ba-44a1-8f4a-9623b758cff2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716215007" status: 202 len: 0 microversion: 2.1 time: 0.039904 Apr 12 08:26:21 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 367/1102] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 08:26:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716215007 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:26:22 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33708. Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:22 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'services' on Instance uuid 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:26:22 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-f6f1ef13-5952-4d6c-893d-b2d393c4557f tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments/fe97f152-352e-43d2-aa94-a9ca218f0d59" status: 202 len: 0 microversion: 2.1 time: 0.222920 Apr 12 08:26:22 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 369/1103] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:26:22 2023] DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments/fe97f152-352e-43d2-aa94-a9ca218f0d59 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:26:22 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:26:22 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-30e656ca-186a-483e-b9ea-b08ca6d46e3b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052208 Apr 12 08:26:22 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:26:22 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:27:12 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:27:12 user devstack@n-api.service[72697]: Wed Apr 12 08:27:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-10a2f7bc-5231-4d30-9227-8a7bfba279ba tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132921 Apr 12 08:27:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 368/1105] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:27:12 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:12 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:27:12 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-67f20f8c-13d1-416f-b313-9b3128fe6dc8 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 204 len: 0 microversion: 2.1 time: 0.118558 Apr 12 08:27:12 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 370/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:27:12 2023] DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:12 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:13 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:27:13 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-13cf9bdf-8d0d-44a1-8c40-daa24cadbfd0 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 200 len: 1670 microversion: 2.1 time: 0.184337 Apr 12 08:27:13 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 369/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:27:12 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 08:27:13 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "name": "network-vif-unplugged", "status": "completed", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:27:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:13 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] Creating event network-vif-unplugged:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:27:13 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-35477601-ddf4-416b-a33f-9035d8668b00 req-609bbfc4-1469-4782-81cf-26ec9d01afb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028777 Apr 12 08:27:13 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 369/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:27:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:27:15 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "name": "network-vif-plugged", "status": "completed", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}, {"server_uuid": "3d081049-b4cf-4ae7-b1ee-9961c9b900c0", "name": "network-vif-deleted", "tag": "cfe0247e-840a-4599-a280-dabc36db725e"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:27:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:27:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:27:15 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:27:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Creating event network-vif-plugged:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:27:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] Creating event network-vif-deleted:cfe0247e-840a-4599-a280-dabc36db725e for instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 on user Apr 12 08:27:15 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-ba8a6e23-53f9-4cce-ae25-97350fac669e req-89ecf27e-e5c6-440a-aa37-00b8cf48565a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031685 Apr 12 08:27:15 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 371/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:28:03 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 HTTP/1.1 Apr 12 08:28:03 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:28:03 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:28:03 user devstack@n-api.service[72696]: Connection: close Apr 12 08:28:03 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:28:03 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:28:03 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:28:03 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:28:03 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:28:03 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:28:03 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:28:03 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:28:03 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:28:03 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:28:03 user devstack@n-api.service[72696]: method: > Apr 12 08:28:03 user devstack@n-api.service[72696]: exception: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:28:03 user devstack@n-api.service[72696]: action_args: {'id': '3d081049-b4cf-4ae7-b1ee-9961c9b900c0'} Apr 12 08:28:03 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:28:03 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:28:03 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:28:03 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-4da88a7e-a733-4d96-8d05-12df4255e483 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 404 len: 111 microversion: 2.1 time: 0.034971 Apr 12 08:28:03 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:28:03 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:28:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-7e595775-e34c-40ad-98b3-1e09312ac889 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '.version_select at 0x7f7bf47c27a0>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:28:03 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-7e595775-e34c-40ad-98b3-1e09312ac889 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177521254" status: 202 len: 0 microversion: 2.1 time: 0.029287 Apr 12 08:28:03 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 370/1111] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 08:28:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177521254 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:28:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:03 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-9d8ee134-819c-45b4-b49e-2f9f79755a6b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: .version_select at 0x7f7c04f81ab0>, body: {"keypair": {"name": "tempest-keypair-105244774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGyZA1ZeqVr3kIkQerkrIxkBYEtaj+f/lnAVisTbMszSIHQ+N6ZlNufmNpj4S0WRt4ACMMPuRWTvUI079G3ER1Cz3BVugopH8sZ5SemmiLBdNoG1JS8/iMoV6plZmP1kw=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:28:03 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-9d8ee134-819c-45b4-b49e-2f9f79755a6b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:28:03 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-9d8ee134-819c-45b4-b49e-2f9f79755a6b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:28:03 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-9d8ee134-819c-45b4-b49e-2f9f79755a6b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058807 Apr 12 08:28:03 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 372/1112] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:28:03 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-923555869", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4602b19a-1eba-495e-be34-e3bd36c8e0b0"}], "security_groups": [{"name": "tempest-securitygroup--194703964"}], "key_name": "tempest-keypair-105244774", "user_data": "}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] validate_networks() for [('4602b19a-1eba-495e-be34-e3bd36c8e0b0', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:28:05 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:28:06 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-07da6dcb-3406-41cd-a012-d63e35722eeb tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.669842 Apr 12 08:28:06 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 371/1113] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:28:05 2023] POST /compute/v2.1/servers => generated 399 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 08:28:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-df523fe2-acd2-4315-b071-b5ce6d606d43 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:28:06 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-df523fe2-acd2-4315-b071-b5ce6d606d43 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:28:06 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-df523fe2-acd2-4315-b071-b5ce6d606d43 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:28:06 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-df523fe2-acd2-4315-b071-b5ce6d606d43 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 200 len: 1234 microversion: 2.1 time: 0.064931 Apr 12 08:28:06 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 371/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:28:06 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 1234 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:28:08 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:28:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:08 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] Creating event network-changed:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:28:08 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-b5accb98-0687-437b-8fe7-86eef4b0173d req-08b8a1d8-0307-467b-aeca-7c9ec29c705f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Apr 12 08:28:08 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 373/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:28:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:28:10 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:28:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:10 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] Creating event network-vif-plugged:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:28:10 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-06dbf442-164a-4d60-a1be-4bbac6f674a0 req-2d7b8325-9211-4c8a-bb35-bdaac3fc0bcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049319 Apr 12 08:28:10 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 372/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:28:12 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:28:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:12 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] Creating event network-vif-plugged:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:28:12 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-3c496dfe-b18e-406a-9c67-e14a052e5572 req-df1bc02c-f563-4534-9aa3-2cf20a51fec6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033915 Apr 12 08:28:12 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 372/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:28:56 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:28:56 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c7be0f55-f706-4b9f-9dc5-c84a5bb27a63 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 200 len: 1543 microversion: 2.1 time: 0.341443 Apr 12 08:28:56 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 374/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:28:56 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 1543 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:29:56 user devstack@n-api.service[72696]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f464210b-97e7-4b71-a0ad-5f7b5f8f8cdf] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:56 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:56 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-761a6938-7e62-457e-932a-0abbd3dfc93b tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108259 Apr 12 08:29:56 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 373/1119] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 08:29:56 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-interface => generated 282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:29:57 user devstack@n-api.service[72697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] Creating event network-changed:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:29:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-373558af-c0ff-4361-96f5-869c8b1eb64d req-4a5c3fa2-8d1d-4a9f-9664-e05b0af11586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095414 Apr 12 08:29:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:29:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:29:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-fd3c6615-592f-4a71-83c4-f6242dc617f2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/ips" status: 200 len: 108 microversion: 2.1 time: 0.045612 Apr 12 08:29:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 375/1121] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:29:57 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f76f5a2-87dd-4fed-af77-e5f70f388066"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:29:58 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:29:58 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] [f464210b-97e7-4b71-a0ad-5f7b5f8f8cdf] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59924. Apr 12 08:29:59 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-26b332aa-2129-4675-bfb6-25b50eb0c503 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298217 Apr 12 08:29:59 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 374/1122] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:29:58 2023] POST /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f76f5a2-87dd-4fed-af77-e5f70f388066"}} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:06 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] [49b60be2-8f91-40d6-bb60-0944b9440d0c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42150. Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:06 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae Apr 12 08:30:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:30:07 user devstack@n-api.service[72697]: request: POST /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments HTTP/1.1 Apr 12 08:30:07 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:30:07 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:30:07 user devstack@n-api.service[72697]: Connection: close Apr 12 08:30:07 user devstack@n-api.service[72697]: Content-Length: 74 Apr 12 08:30:07 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:30:07 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:30:07 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:30:07 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:30:07 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:30:07 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:30:07 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:30:07 user devstack@n-api.service[72697]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:30:07 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:30:07 user devstack@n-api.service[72697]: Apr 12 08:30:07 user devstack@n-api.service[72697]: {"volumeAttachment": {"volumeId": "5f76f5a2-87dd-4fed-af77-e5f70f388066"}} Apr 12 08:30:07 user devstack@n-api.service[72697]: method: > Apr 12 08:30:07 user devstack@n-api.service[72697]: exception: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae Apr 12 08:30:07 user devstack@n-api.service[72697]: action_args: {'server_id': '7a45ae66-bd9d-46f9-901c-fb2e471a25ae', 'body': {'volumeAttachment': {'volumeId': '5f76f5a2-87dd-4fed-af77-e5f70f388066'}}} Apr 12 08:30:07 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae Apr 12 08:30:07 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:30:07 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 400 to user: Invalid volume: volume 5f76f5a2-87dd-4fed-af77-e5f70f388066 is already attached to instances: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:30:07 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-559c0546-fffe-4651-a1f6-e273f68dbba6 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270159 Apr 12 08:30:07 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 374/1123] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:30:06 2023] POST /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:07 user devstack@n-api.service[72695]: DEBUG nova.objects.instance [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'services' on Instance uuid 7a45ae66-bd9d-46f9-901c-fb2e471a25ae {{(pid=72695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:30:07 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-6d3870d3-490a-40e0-950c-901a5ccd4aef tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments/5f76f5a2-87dd-4fed-af77-e5f70f388066" status: 202 len: 0 microversion: 2.1 time: 0.186029 Apr 12 08:30:07 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 376/1124] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:30:07 2023] DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments/5f76f5a2-87dd-4fed-af77-e5f70f388066 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:07 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:07 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-b80b68ce-337e-4182-8946-c3cb276429d2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051799 Apr 12 08:30:07 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 375/1125] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:30:07 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:57 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:30:57 user devstack@n-api.service[72697]: Wed Apr 12 08:30:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-811a1d9b-d770-45cf-b75b-d7b857eef96d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058050 Apr 12 08:30:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 375/1126] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:30:57 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:57 user devstack@n-api.service[72695]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Going to try to terminate instance {{(pid=72695) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:30:57 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-c3cd4c1a-b02a-4d68-b806-9601df8bc777 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 204 len: 0 microversion: 2.1 time: 0.118229 Apr 12 08:30:57 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 377/1127] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:30:57 2023] DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:30:57 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:30:57 user devstack@n-api.service[72696]: Wed Apr 12 08:30:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae (ip 10.0.0.210) !!! Apr 12 08:30:57 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:30:57 user devstack@n-api.service[72696]: Wed Apr 12 08:30:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae (ip 10.0.0.210) !!! Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:57 user devstack@n-api.service[72696]: DEBUG nova.policy [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72696) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:30:57 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-76b5d6e5-d2a4-471f-87dd-ae230b950312 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 200 len: 1668 microversion: 2.1 time: 0.192507 Apr 12 08:30:57 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 376/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:30:57 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "name": "network-vif-unplugged", "status": "completed", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:30:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:30:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] Creating event network-vif-unplugged:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:30:58 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-e902c604-cf15-4a2c-ad5a-151fd2681115 req-afe8564f-c9a5-4378-89d4-462e07be792b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166691 Apr 12 08:30:58 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 376/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:31:00 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "name": "network-vif-plugged", "status": "completed", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}, {"server_uuid": "7a45ae66-bd9d-46f9-901c-fb2e471a25ae", "name": "network-vif-deleted", "tag": "b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:00 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:00 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39562. Apr 12 08:31:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Creating event network-vif-plugged:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:31:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] Creating event network-vif-deleted:b8fb9391-b6e7-4721-8adc-bbb8cabcc4bd for instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae on user Apr 12 08:31:00 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-671104d2-cd67-46cf-884c-6eba1eb0d698 req-f722112a-3eda-404a-bda3-02b7b8925fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034313 Apr 12 08:31:00 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 378/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:31:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:47 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:31:47 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae HTTP/1.1 Apr 12 08:31:47 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:31:47 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:31:47 user devstack@n-api.service[72696]: Connection: close Apr 12 08:31:47 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:31:47 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:31:47 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:31:47 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:31:47 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:31:47 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:31:47 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:31:47 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:31:47 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:31:47 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:31:47 user devstack@n-api.service[72696]: method: > Apr 12 08:31:47 user devstack@n-api.service[72696]: exception: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:31:47 user devstack@n-api.service[72696]: action_args: {'id': '7a45ae66-bd9d-46f9-901c-fb2e471a25ae'} Apr 12 08:31:47 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:31:47 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:31:47 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:31:47 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-236310f7-f52d-4b62-8a0f-bd4f99bbdaf2 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 404 len: 111 microversion: 2.1 time: 0.036990 Apr 12 08:31:47 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 377/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:31:47 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:31:47 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:47 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=8 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:47 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4a2f7f79-b8ea-495f-b606-9afb1a556d9a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '.version_select at 0x7f7bf4722b90>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:31:47 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4a2f7f79-b8ea-495f-b606-9afb1a556d9a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105244774" status: 202 len: 0 microversion: 2.1 time: 0.040734 Apr 12 08:31:47 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 377/1132] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 08:31:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105244774 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 08:31:48 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:48 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:31:48 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-cd03b20c-b0e8-4580-b8f8-5fc6fbec5939 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: .version_select at 0x7f7c04f21c60>, body: {"keypair": {"name": "tempest-keypair-1879219279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHZCSN81t3Io3Y++NE4Gh0YasDUXE842ZBA6mOygVjGPbzO4CGVo8mbqa+gXO481QBrTnr6SFedIV8i+AuHemQ7wQMrEXDAgFVNa9s9LF3GPqX9JOFdDmQgrejfgLEvTg=="}} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:48 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-cd03b20c-b0e8-4580-b8f8-5fc6fbec5939 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:31:48 user devstack@n-api.service[72695]: DEBUG nova.quota [None req-cd03b20c-b0e8-4580-b8f8-5fc6fbec5939 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'key_pairs'} {{(pid=72695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:31:48 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-cd03b20c-b0e8-4580-b8f8-5fc6fbec5939 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060945 Apr 12 08:31:48 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 379/1133] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 08:31:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1363091089", "imageRef": "68a0a523-85da-4c40-ac88-5d5f304c0b18", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4602b19a-1eba-495e-be34-e3bd36c8e0b0"}], "security_groups": [{"name": "tempest-securitygroup--1189942606"}], "key_name": "tempest-keypair-1879219279", "user_data": "}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.network.neutron [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] validate_networks() for [('4602b19a-1eba-495e-be34-e3bd36c8e0b0', None, None, None, None, None)] {{(pid=72696) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image limits 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Flavor pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Image pref 0:0:0 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.virt.hardware [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.quota [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Getting quotas for user bc8316aee1bb41ef99be6777924a33d8 and project a47cb4fc9e2640399e7df51f12de123d. Resources: {'ram', 'instances', 'cores'} {{(pid=72696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Going to run 1 instances... {{(pid=72696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 08:31:50 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68a0a523-85da-4c40-ac88-5d5f304c0b18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 08:31:50 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-48a7ee26-98c5-4193-86f6-5158ad64da60 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.603883 Apr 12 08:31:50 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 378/1134] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 08:31:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 08:31:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-39412e98-1f22-49d2-9278-da60d7c63520 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:31:50 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-39412e98-1f22-49d2-9278-da60d7c63520 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:31:50 user devstack@n-api.service[72697]: DEBUG nova.policy [None req-39412e98-1f22-49d2-9278-da60d7c63520 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72697) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:31:50 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-39412e98-1f22-49d2-9278-da60d7c63520 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 200 len: 1236 microversion: 2.1 time: 0.070794 Apr 12 08:31:50 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 378/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:31:50 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 08:31:53 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:53 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.compute.server_external_events [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] Creating event network-changed:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:31:53 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [req-9f02eb8b-07e6-40c7-9819-e387324a92e4 req-e31d0db0-78a3-4ca3-9e0a-3f7b0f7bb089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029664 Apr 12 08:31:53 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 380/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:31:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:31:55 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "name": "network-vif-plugged", "status": "completed", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:55 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] Creating event network-vif-plugged:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:31:55 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-a42144ee-cebb-46fa-b2c1-c17352994729 req-e4e2afd3-ed2d-4f65-8d4c-06ffbe16a736 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057974 Apr 12 08:31:55 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 379/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:31:57 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "name": "network-vif-plugged", "status": "completed", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:31:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:31:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:31:57 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:31:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] Creating event network-vif-plugged:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:31:57 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ec9ec619-2b64-4201-8dc5-93a4697c65d5 req-b50df00f-a598-42fe-a54d-a20db7baa76b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 Apr 12 08:31:57 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 379/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell0:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:32:41 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:32:41 user devstack@n-api.service[72695]: Wed Apr 12 08:32:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 (ip 10.0.0.210) !!! Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:32:41 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:32:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-0ebebb91-dc39-420f-9b7f-6d817ec6fd79 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 200 len: 1546 microversion: 2.1 time: 0.322922 Apr 12 08:32:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 381/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:32:41 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 1546 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=2 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell0:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=6 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-669c7a05-9503-4d8e-85ab-a47f52bec5f4 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.279347 Apr 12 08:33:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 380/1140] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 08:33:41 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-interface => generated 282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell0:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:42 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 08:33:42 user devstack@n-api.service[72697]: Wed Apr 12 08:33:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=2 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:42 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] Creating event network-changed:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:33:42 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-3ab11eb0-5098-4051-acf9-7a258d5c16cc req-555b8e0b-fe52-47ef-8eaf-bcaedcb244f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058788 Apr 12 08:33:42 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 380/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:42 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:42 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-d2161645-0b22-4230-932b-a30efb13fa52 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/ips" status: 200 len: 108 microversion: 2.1 time: 0.044070 Apr 12 08:33:42 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 382/1142] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 08:33:42 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/ips => generated 108 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb"}} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:43 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:44 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-23934419-b4aa-46d9-a770-95b37e1572af tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "POST /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298658 Apr 12 08:33:44 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 381/1143] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 08:33:43 2023] POST /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:50 user devstack@n-api.service[72697]: DEBUG nova.objects.instance [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lazy-loading 'services' on Instance uuid 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 {{(pid=72697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 08:33:51 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-8de6f627-843a-450a-bc1b-a186ec096b2d tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments/fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb" status: 202 len: 0 microversion: 2.1 time: 0.256546 Apr 12 08:33:51 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 381/1144] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 08:33:50 2023] DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments/fc2dfaf2-6b4f-4a59-b1ea-5221dc3caabb => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:33:51 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:33:51 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-454fd21c-cfcd-4648-954f-e8d35420d6d1 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 Apr 12 08:33:51 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 383/1145] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:33:51 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 08:34:41 user devstack@n-api.service[72696]: Wed Apr 12 08:34:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-cc1df3d8-117e-4030-a8f0-5a6830c1fc98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056742 Apr 12 08:34:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 382/1146] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 08:34:41 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 08:34:41 user devstack@n-api.service[72697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 08:34:41 user devstack@n-api.service[72697]: Wed Apr 12 08:34:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 (ip 10.0.0.210) !!! Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=4 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Going to try to terminate instance {{(pid=72697) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 08:34:41 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4697f8ff-5b9a-47c5-a0ec-7afdb780f3ca tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 204 len: 0 microversion: 2.1 time: 0.139812 Apr 12 08:34:41 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 382/1147] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:34:41 2023] DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=4 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=10 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "name": "network-vif-unplugged", "status": "completed", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:41 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.compute.server_external_events [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] Creating event network-vif-unplugged:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:34:41 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [req-3db3bdc1-e6cd-4e4a-be13-eb563a78ddcd req-613507b2-285d-4f1f-b629-18c5f03e719d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038583 Apr 12 08:34:41 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 383/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:34:41 user devstack@n-api.service[72695]: DEBUG nova.policy [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8316aee1bb41ef99be6777924a33d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47cb4fc9e2640399e7df51f12de123d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72695) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 08:34:41 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-a7826dc5-341c-4e4b-a840-942578621d18 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 200 len: 1670 microversion: 2.1 time: 0.390831 Apr 12 08:34:41 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 384/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:34:41 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 08:34:43 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "name": "network-vif-plugged", "status": "completed", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}, {"server_uuid": "83e1d52a-a5aa-47ac-85ef-ef85ca3afb95", "name": "network-vif-deleted", "tag": "ef876483-6e28-412d-812e-4dcc46a83e72"}]} {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 08:34:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:34:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:34:43 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:34:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Creating event network-vif-plugged:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:34:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.compute.server_external_events [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] Creating event network-vif-deleted:ef876483-6e28-412d-812e-4dcc46a83e72 for instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 on user Apr 12 08:34:43 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [req-ae0796f2-d4bf-413f-b23d-24465aff999f req-d6dcfd50-1e50-40bf-ae1e-8e6eda0f5f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034734 Apr 12 08:34:43 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 383/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 08:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_api:SELECT=4 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG dbcounter [-] [72696] Writing DB stats nova_cell1:SELECT=8 {{(pid=72696) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:31 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 HTTP/1.1 Apr 12 08:35:31 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:35:31 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:35:31 user devstack@n-api.service[72696]: Connection: close Apr 12 08:35:31 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:35:31 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:35:31 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:35:31 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:35:31 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:31 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:31 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:35:31 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:35:31 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:31 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:31 user devstack@n-api.service[72696]: method: > Apr 12 08:35:31 user devstack@n-api.service[72696]: exception: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:31 user devstack@n-api.service[72696]: action_args: {'id': '83e1d52a-a5aa-47ac-85ef-ef85ca3afb95'} Apr 12 08:35:31 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:31 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:31 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:31 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-1eb4a63d-9c8d-432e-978c-006d35ea3e17 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 404 len: 111 microversion: 2.1 time: 0.037388 Apr 12 08:35:31 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 384/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:35:31 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:31 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-b669c74e-68c1-4244-9d3c-861297e9ec38 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '.version_select at 0x7f7c056eb9a0>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:31 user devstack@n-api.service[72695]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 08:35:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_api:SELECT=2 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:31 user devstack@n-api.service[72695]: DEBUG dbcounter [-] [72695] Writing DB stats nova_cell1:SELECT=6 {{(pid=72695) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:31 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-b669c74e-68c1-4244-9d3c-861297e9ec38 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879219279" status: 202 len: 0 microversion: 2.1 time: 0.033909 Apr 12 08:35:31 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 385/1152] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 08:35:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879219279 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG dbcounter [-] [72697] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72697) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:34 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 HTTP/1.1 Apr 12 08:35:34 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:35:34 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:35:34 user devstack@n-api.service[72697]: Connection: close Apr 12 08:35:34 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:35:34 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:35:34 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:35:34 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:35:34 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:34 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:34 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:35:34 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:35:34 user devstack@n-api.service[72697]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:34 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:34 user devstack@n-api.service[72697]: method: > Apr 12 08:35:34 user devstack@n-api.service[72697]: exception: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72697]: action_args: {'id': '83e1d52a-a5aa-47ac-85ef-ef85ca3afb95'} Apr 12 08:35:34 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:34 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-4dc9868c-6e86-4e90-8914-f14e17ea9206 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 404 len: 111 microversion: 2.1 time: 0.041460 Apr 12 08:35:34 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 384/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:35:34 2023] DELETE /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:34 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 HTTP/1.1 Apr 12 08:35:34 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:35:34 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:35:34 user devstack@n-api.service[72696]: Connection: close Apr 12 08:35:34 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:35:34 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:35:34 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:35:34 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:35:34 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:34 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:34 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:35:34 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:35:34 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:34 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:34 user devstack@n-api.service[72696]: method: > Apr 12 08:35:34 user devstack@n-api.service[72696]: exception: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72696]: action_args: {'id': '83e1d52a-a5aa-47ac-85ef-ef85ca3afb95'} Apr 12 08:35:34 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. Apr 12 08:35:34 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:34 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:34 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-e512db12-1799-4d3f-baca-79d2e84726bf tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95" status: 404 len: 111 microversion: 2.1 time: 0.034493 Apr 12 08:35:34 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 385/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:35:34 2023] GET /compute/v2.1/servers/83e1d52a-a5aa-47ac-85ef-ef85ca3afb95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:37 user devstack@n-api.service[72695]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bbf5b06-4311-4391-b062-802be37749ae] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53542. Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:37 user devstack@n-api.service[72695]: request: DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae HTTP/1.1 Apr 12 08:35:37 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:35:37 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:35:37 user devstack@n-api.service[72695]: Connection: close Apr 12 08:35:37 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:35:37 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:35:37 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:35:37 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:35:37 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72695]: method: > Apr 12 08:35:37 user devstack@n-api.service[72695]: exception: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: action_args: {'id': '7a45ae66-bd9d-46f9-901c-fb2e471a25ae'} Apr 12 08:35:37 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-8b990654-f52d-4c7c-a784-65024006ee6a tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 404 len: 111 microversion: 2.1 time: 0.043155 Apr 12 08:35:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 386/1155] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:35:37 2023] DELETE /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 7a45ae66-bd9d-46f9-901c-fb2e471a25ae] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:37 user devstack@n-api.service[72697]: request: GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae HTTP/1.1 Apr 12 08:35:37 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:35:37 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:35:37 user devstack@n-api.service[72697]: Connection: close Apr 12 08:35:37 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:35:37 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:35:37 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:35:37 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:35:37 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72697]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:37 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72697]: method: > Apr 12 08:35:37 user devstack@n-api.service[72697]: exception: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72697]: action_args: {'id': '7a45ae66-bd9d-46f9-901c-fb2e471a25ae'} Apr 12 08:35:37 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. Apr 12 08:35:37 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 7a45ae66-bd9d-46f9-901c-fb2e471a25ae could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:37 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-78aa378e-db05-48fc-8b22-d3ca93258039 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae" status: 404 len: 111 microversion: 2.1 time: 0.032589 Apr 12 08:35:37 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 385/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:35:37 2023] GET /compute/v2.1/servers/7a45ae66-bd9d-46f9-901c-fb2e471a25ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:37 user devstack@n-api.service[72696]: request: DELETE /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 HTTP/1.1 Apr 12 08:35:37 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:35:37 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:35:37 user devstack@n-api.service[72696]: Connection: close Apr 12 08:35:37 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:35:37 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:35:37 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:35:37 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:35:37 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:37 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72696]: method: > Apr 12 08:35:37 user devstack@n-api.service[72696]: exception: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72696]: action_args: {'id': 'faec6a92-b2ab-44c3-a045-2c36968bc0a6'} Apr 12 08:35:37 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:37 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-ff366644-d9ee-415e-aeb7-0256656adb98 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 404 len: 111 microversion: 2.1 time: 0.035174 Apr 12 08:35:37 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 386/1157] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:35:37 2023] DELETE /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.compute.api [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: faec6a92-b2ab-44c3-a045-2c36968bc0a6] Fetching instance by UUID {{(pid=72695) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG oslo_concurrency.lockutils [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72695) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.wsgi [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:37 user devstack@n-api.service[72695]: request: GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 HTTP/1.1 Apr 12 08:35:37 user devstack@n-api.service[72695]: Accept: application/json Apr 12 08:35:37 user devstack@n-api.service[72695]: Accept-Encoding: identity Apr 12 08:35:37 user devstack@n-api.service[72695]: Connection: close Apr 12 08:35:37 user devstack@n-api.service[72695]: Content-Length: 0 Apr 12 08:35:37 user devstack@n-api.service[72695]: Content-Type: application/json Apr 12 08:35:37 user devstack@n-api.service[72695]: Host: 10.0.0.210 Apr 12 08:35:37 user devstack@n-api.service[72695]: Openstack-System-Scope: None Apr 12 08:35:37 user devstack@n-api.service[72695]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Domain-Id: None Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Domain-Name: None Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Identity-Status: Confirmed Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Is-Admin-Project: True Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Role: member,reader Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Roles: member,reader Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:37 user devstack@n-api.service[72695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Domain-Id: default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Domain-Name: Default Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:37 user devstack@n-api.service[72695]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:37 user devstack@n-api.service[72695]: method: > Apr 12 08:35:37 user devstack@n-api.service[72695]: exception: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: action_args: {'id': 'faec6a92-b2ab-44c3-a045-2c36968bc0a6'} Apr 12 08:35:37 user devstack@n-api.service[72695]: {{(pid=72695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. Apr 12 08:35:37 user devstack@n-api.service[72695]: ERROR nova.api.openstack.wsgi Apr 12 08:35:37 user devstack@n-api.service[72695]: DEBUG nova.api.openstack.wsgi [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance faec6a92-b2ab-44c3-a045-2c36968bc0a6 could not be found. {{(pid=72695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:37 user devstack@n-api.service[72695]: INFO nova.api.openstack.requestlog [None req-63c6985d-7684-49a1-94a0-766ac236c74e tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6" status: 404 len: 111 microversion: 2.1 time: 0.027670 Apr 12 08:35:37 user devstack@n-api.service[72695]: [pid: 72695|app: 0|req: 387/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:35:37 2023] GET /compute/v2.1/servers/faec6a92-b2ab-44c3-a045-2c36968bc0a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG nova.compute.api [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72697) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG oslo_concurrency.lockutils [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72697) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.wsgi [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:39 user devstack@n-api.service[72697]: request: DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 HTTP/1.1 Apr 12 08:35:39 user devstack@n-api.service[72697]: Accept: application/json Apr 12 08:35:39 user devstack@n-api.service[72697]: Accept-Encoding: identity Apr 12 08:35:39 user devstack@n-api.service[72697]: Connection: close Apr 12 08:35:39 user devstack@n-api.service[72697]: Content-Length: 0 Apr 12 08:35:39 user devstack@n-api.service[72697]: Content-Type: application/json Apr 12 08:35:39 user devstack@n-api.service[72697]: Host: 10.0.0.210 Apr 12 08:35:39 user devstack@n-api.service[72697]: Openstack-System-Scope: None Apr 12 08:35:39 user devstack@n-api.service[72697]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Domain-Id: None Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Domain-Name: None Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Identity-Status: Confirmed Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Is-Admin-Project: True Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Project-Domain-Id: default Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Project-Domain-Name: Default Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Role: member,reader Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Roles: member,reader Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:39 user devstack@n-api.service[72697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:39 user devstack@n-api.service[72697]: X-User-Domain-Id: default Apr 12 08:35:39 user devstack@n-api.service[72697]: X-User-Domain-Name: Default Apr 12 08:35:39 user devstack@n-api.service[72697]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:39 user devstack@n-api.service[72697]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:39 user devstack@n-api.service[72697]: method: > Apr 12 08:35:39 user devstack@n-api.service[72697]: exception: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72697]: action_args: {'id': '3d081049-b4cf-4ae7-b1ee-9961c9b900c0'} Apr 12 08:35:39 user devstack@n-api.service[72697]: {{(pid=72697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72697]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72697]: DEBUG nova.api.openstack.wsgi [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. {{(pid=72697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:39 user devstack@n-api.service[72697]: INFO nova.api.openstack.requestlog [None req-dba53aff-e874-4d67-8b4f-6383e93c5e2c tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 404 len: 111 microversion: 2.1 time: 0.036633 Apr 12 08:35:39 user devstack@n-api.service[72697]: [pid: 72697|app: 0|req: 386/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 08:35:39 2023] DELETE /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Calling method '>' {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG nova.compute.api [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] [instance: 3d081049-b4cf-4ae7-b1ee-9961c9b900c0] Fetching instance by UUID {{(pid=72696) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Acquiring lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG oslo_concurrency.lockutils [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Lock "27d09cc3-e598-49d1-9784-b0c83c8af98c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72696) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 08:35:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.wsgi [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] HTTP exception thrown: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Request method failure captured: Apr 12 08:35:39 user devstack@n-api.service[72696]: request: GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 HTTP/1.1 Apr 12 08:35:39 user devstack@n-api.service[72696]: Accept: application/json Apr 12 08:35:39 user devstack@n-api.service[72696]: Accept-Encoding: identity Apr 12 08:35:39 user devstack@n-api.service[72696]: Connection: close Apr 12 08:35:39 user devstack@n-api.service[72696]: Content-Length: 0 Apr 12 08:35:39 user devstack@n-api.service[72696]: Content-Type: application/json Apr 12 08:35:39 user devstack@n-api.service[72696]: Host: 10.0.0.210 Apr 12 08:35:39 user devstack@n-api.service[72696]: Openstack-System-Scope: None Apr 12 08:35:39 user devstack@n-api.service[72696]: User-Agent: python-urllib3/1.26.15 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Auth-Token: gAAAAABkNmoOGChrkMOvIJYPw07CGUDq5Jemza7AsgUn0DD04ru2InC4_WpKptstOwRMYERXzKNX5Is8bdyt-Z06zSeKdCvaCYsmlxKazGhYJf_awEs40XVRLhxtZNFTVH8ZakqU5OUVKesFRRpl82HWZ2H_WivSapbVeVQF8DumptCWrOLqJQ8 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Domain-Id: None Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Domain-Name: None Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Identity-Status: Confirmed Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Is-Admin-Project: True Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Project-Domain-Id: default Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Project-Domain-Name: Default Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Project-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Role: member,reader Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Roles: member,reader Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a47cb4fc9e2640399e7df51f12de123d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Tenant: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Tenant-Id: a47cb4fc9e2640399e7df51f12de123d Apr 12 08:35:39 user devstack@n-api.service[72696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1980986093 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-User: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:39 user devstack@n-api.service[72696]: X-User-Domain-Id: default Apr 12 08:35:39 user devstack@n-api.service[72696]: X-User-Domain-Name: Default Apr 12 08:35:39 user devstack@n-api.service[72696]: X-User-Id: bc8316aee1bb41ef99be6777924a33d8 Apr 12 08:35:39 user devstack@n-api.service[72696]: X-User-Name: tempest-AttachVolumeNegativeTest-1980986093-project-member Apr 12 08:35:39 user devstack@n-api.service[72696]: method: > Apr 12 08:35:39 user devstack@n-api.service[72696]: exception: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72696]: action_args: {'id': '3d081049-b4cf-4ae7-b1ee-9961c9b900c0'} Apr 12 08:35:39 user devstack@n-api.service[72696]: {{(pid=72696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. Apr 12 08:35:39 user devstack@n-api.service[72696]: ERROR nova.api.openstack.wsgi Apr 12 08:35:39 user devstack@n-api.service[72696]: DEBUG nova.api.openstack.wsgi [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] Returning 404 to user: Instance 3d081049-b4cf-4ae7-b1ee-9961c9b900c0 could not be found. {{(pid=72696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 08:35:39 user devstack@n-api.service[72696]: INFO nova.api.openstack.requestlog [None req-c49ff970-0330-4e6b-a45c-807dc2cb5479 tempest-AttachVolumeNegativeTest-1980986093 tempest-AttachVolumeNegativeTest-1980986093-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0" status: 404 len: 111 microversion: 2.1 time: 0.031891 Apr 12 08:35:39 user devstack@n-api.service[72696]: [pid: 72696|app: 0|req: 387/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 08:35:39 2023] GET /compute/v2.1/servers/3d081049-b4cf-4ae7-b1ee-9961c9b900c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)